2023-03-06T14:05:07.295 INFO:root:teuthology version: 0.0.1.dev51+ga2dfb05 2023-03-06T14:05:07.296 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7195216 --name vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi --description fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7195216/orig.config.yaml 2023-03-06T14:05:07.339 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-03-06T14:05:07.416 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7195216 branch: wip-vshankar-testing-20230303.023823 description: fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} email: vshankar@redhat.com first_in_suite: false job_id: '7195216' kernel: client: sha1: distro flavor: default kdb: true sha1: 75534f74ac3dd06f86697ff862e8be2945b3c8e6 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-vshankar-testing-20230303.023823 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230303.023823 sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b owner: scheduled_vshankar@teuthology priority: 30 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20230303.023823 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi003.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi136.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - workunit: clients: all: - fs/snaps timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: a2dfb0599b24ec4a1585108a2792a4567ce0a378 timestamp: 2023-03-06_13:28:53 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.31660 2023-03-06T14:05:07.416 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa; will attempt to use it 2023-03-06T14:05:07.417 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa/tasks 2023-03-06T14:05:07.417 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-03-06T14:05:07.419 INFO:teuthology.task.internal:Checking packages... 2023-03-06T14:05:07.448 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '472aaef4ec3b3a2c29f73ca67854785a910f1f9b' 2023-03-06T14:05:07.448 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-03-06T14:05:07.449 INFO:teuthology.packaging:ref: None 2023-03-06T14:05:07.449 INFO:teuthology.packaging:tag: None 2023-03-06T14:05:07.449 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230303.023823 2023-03-06T14:05:07.449 INFO:teuthology.packaging:sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-06T14:05:07.450 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20230303.023823 2023-03-06T14:05:07.596 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-2739.g472aaef4 2023-03-06T14:05:07.596 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-03-06T14:05:07.602 INFO:teuthology.task.internal:no buildpackages task found 2023-03-06T14:05:07.603 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-03-06T14:05:07.643 INFO:teuthology.task.internal:Saving configuration 2023-03-06T14:05:07.663 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-03-06T14:05:07.669 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-06T14:05:07.700 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7195216', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-06 14:00:12.506784', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-03-06T14:05:07.730 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7195216', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-06 14:00:12.508845', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-03-06T14:05:07.731 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-03-06T14:05:07.736 INFO:teuthology.task.internal:roles: ubuntu@smithi003.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-03-06T14:05:07.736 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-03-06T14:05:07.736 INFO:teuthology.run_tasks:Running task console_log... 2023-03-06T14:05:07.820 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb5367284c0>, signals=[15]) 2023-03-06T14:05:07.822 INFO:teuthology.run_tasks:Running task internal.connect... 2023-03-06T14:05:07.827 INFO:teuthology.task.internal:Opening connections... 2023-03-06T14:05:07.827 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi003.front.sepia.ceph.com 2023-03-06T14:05:07.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-06T14:05:07.901 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2023-03-06T14:05:07.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-06T14:05:07.970 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-03-06T14:05:07.975 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-03-06T14:05:07.997 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-03-06T14:05:07.997 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-03-06T14:05:08.057 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Red Hat Enterprise Linux" 2023-03-06T14:05:08.058 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8.6 (Ootpa)" 2023-03-06T14:05:08.058 INFO:teuthology.orchestra.run.smithi003.stdout:ID="rhel" 2023-03-06T14:05:08.058 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="fedora" 2023-03-06T14:05:08.058 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8.6" 2023-03-06T14:05:08.059 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2023-03-06T14:05:08.059 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-06T14:05:08.059 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-03-06T14:05:08.059 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-06T14:05:08.059 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.redhat.com/" 2023-03-06T14:05:08.059 INFO:teuthology.orchestra.run.smithi003.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-06T14:05:08.059 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-06T14:05:08.060 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:05:08.060 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-06T14:05:08.060 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-06T14:05:08.060 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-06T14:05:08.060 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-06T14:05:08.062 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-03-06T14:05:08.091 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2023-03-06T14:05:08.112 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2023-03-06T14:05:08.113 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2023-03-06T14:05:08.171 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Red Hat Enterprise Linux" 2023-03-06T14:05:08.172 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8.6 (Ootpa)" 2023-03-06T14:05:08.172 INFO:teuthology.orchestra.run.smithi136.stdout:ID="rhel" 2023-03-06T14:05:08.172 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="fedora" 2023-03-06T14:05:08.172 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8.6" 2023-03-06T14:05:08.173 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2023-03-06T14:05:08.173 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-06T14:05:08.173 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2023-03-06T14:05:08.173 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-06T14:05:08.174 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.redhat.com/" 2023-03-06T14:05:08.174 INFO:teuthology.orchestra.run.smithi136.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-06T14:05:08.174 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-06T14:05:08.174 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:05:08.174 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-06T14:05:08.174 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-06T14:05:08.175 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-06T14:05:08.175 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-06T14:05:08.175 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2023-03-06T14:05:08.199 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-03-06T14:05:08.212 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-03-06T14:05:08.218 INFO:teuthology.task.internal:Checking for old test directory... 2023-03-06T14:05:08.219 DEBUG:teuthology.orchestra.run.smithi003:> test '!' -e /home/ubuntu/cephtest 2023-03-06T14:05:08.221 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2023-03-06T14:05:08.239 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-03-06T14:05:08.246 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-03-06T14:05:08.247 DEBUG:teuthology.orchestra.run.smithi003:> test -z $(ls -A /var/lib/ceph) 2023-03-06T14:05:08.281 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2023-03-06T14:05:08.325 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-03-06T14:05:08.394 INFO:teuthology.run_tasks:Running task kernel... 2023-03-06T14:05:08.408 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '75534f74ac3dd06f86697ff862e8be2945b3c8e6'} 2023-03-06T14:05:08.409 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2023-03-06T14:05:08.409 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2023-03-06T14:05:08.410 DEBUG:teuthology.orchestra.run.smithi003:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-06T14:05:08.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-06T14:05:08.430 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2023-03-06T14:05:08.489 INFO:teuthology.orchestra.run.smithi003.stdout:4.18.0-372.9.1.el8.x86_64 2023-03-06T14:05:08.490 INFO:teuthology.task.kernel:Running kernel on smithi003: 4.18.0-372.9.1.el8.x86_64 2023-03-06T14:05:08.490 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum install -y kernel 2023-03-06T14:05:09.633 INFO:teuthology.orchestra.run.smithi003.stdout:Updating Subscription Management repositories. 2023-03-06T14:05:09.634 INFO:teuthology.orchestra.run.smithi003.stdout:Unable to read consumer identity 2023-03-06T14:05:11.050 INFO:teuthology.orchestra.run.smithi003.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2023-03-06T14:05:12.218 INFO:teuthology.orchestra.run.smithi003.stdout:Extra Packages for Enterprise Linux 12 MB/s | 14 MB 00:01 2023-03-06T14:05:15.493 INFO:teuthology.orchestra.run.smithi003.stdout:lab-extras 477 kB/s | 24 kB 00:00 2023-03-06T14:05:16.145 INFO:teuthology.orchestra.run.smithi003.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-03-06T14:05:16.195 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2023-03-06T14:05:16.196 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2023-03-06T14:05:16.196 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2023-03-06T14:05:16.327 DEBUG:teuthology.orchestra.run.smithi003:> echo no | sudo yum reinstall kernel || true 2023-03-06T14:05:16.681 INFO:teuthology.orchestra.run.smithi003.stdout:Updating Subscription Management repositories. 2023-03-06T14:05:16.682 INFO:teuthology.orchestra.run.smithi003.stdout:Unable to read consumer identity 2023-03-06T14:05:16.952 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:00:01 ago on Mon 06 Mar 2023 02:05:15 PM UTC. 2023-03-06T14:05:16.999 INFO:teuthology.orchestra.run.smithi003.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-03-06T14:05:17.046 INFO:teuthology.orchestra.run.smithi003.stderr:Error: No packages marked for reinstall. 2023-03-06T14:05:17.093 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum reinstall -y kernel || true 2023-03-06T14:05:17.444 INFO:teuthology.orchestra.run.smithi003.stdout:Updating Subscription Management repositories. 2023-03-06T14:05:17.444 INFO:teuthology.orchestra.run.smithi003.stdout:Unable to read consumer identity 2023-03-06T14:05:17.705 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:00:02 ago on Mon 06 Mar 2023 02:05:15 PM UTC. 2023-03-06T14:05:17.748 INFO:teuthology.orchestra.run.smithi003.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-03-06T14:05:17.787 INFO:teuthology.orchestra.run.smithi003.stderr:Error: No packages marked for reinstall. 2023-03-06T14:05:17.834 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q kernel --last | head -n 1 2023-03-06T14:05:17.916 INFO:teuthology.orchestra.run.smithi003.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2023-03-06T14:05:17.918 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-03-06T14:05:17.918 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-03-06T14:05:17.918 DEBUG:teuthology.parallel:result is None 2023-03-06T14:05:17.918 INFO:teuthology.run_tasks:Running task internal.base... 2023-03-06T14:05:17.925 INFO:teuthology.task.internal:Creating test directory... 2023-03-06T14:05:17.926 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-06T14:05:17.928 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-06T14:05:17.948 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-03-06T14:05:17.955 INFO:teuthology.run_tasks:Running task internal.archive... 2023-03-06T14:05:17.961 INFO:teuthology.task.internal:Creating archive directory... 2023-03-06T14:05:17.962 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-06T14:05:17.985 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-06T14:05:18.029 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-03-06T14:05:18.036 INFO:teuthology.task.internal:Enabling coredump saving... 2023-03-06T14:05:18.036 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-06T14:05:18.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-06T14:05:18.084 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-06T14:05:18.086 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-06T14:05:18.112 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-06T14:05:18.123 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-06T14:05:18.159 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-06T14:05:18.181 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-06T14:05:18.182 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-03-06T14:05:18.189 INFO:teuthology.task.internal:Configuring sudo... 2023-03-06T14:05:18.190 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-06T14:05:18.192 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-06T14:05:18.251 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-03-06T14:05:18.261 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-03-06T14:05:18.262 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-06T14:05:18.264 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-06T14:05:18.310 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-06T14:05:18.367 DEBUG:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-06T14:05:18.417 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-06T14:05:18.502 DEBUG:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-06T14:05:18.543 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:05:18.543 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-06T14:05:18.611 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-06T14:05:18.659 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-06T14:05:18.708 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-06T14:05:18.802 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-06T14:05:18.835 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:05:18.835 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-06T14:05:18.902 DEBUG:teuthology.orchestra.run.smithi003:> sudo service rsyslog restart 2023-03-06T14:05:18.904 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2023-03-06T14:05:18.965 INFO:teuthology.orchestra.run.smithi003.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-03-06T14:05:18.996 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-03-06T14:05:19.306 INFO:teuthology.run_tasks:Running task internal.timer... 2023-03-06T14:05:19.313 INFO:teuthology.task.internal:Starting timer... 2023-03-06T14:05:19.313 INFO:teuthology.run_tasks:Running task pcp... 2023-03-06T14:05:19.378 INFO:teuthology.run_tasks:Running task selinux... 2023-03-06T14:05:19.386 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-03-06T14:05:19.387 DEBUG:teuthology.orchestra.run.smithi003:> sudo service auditd rotate 2023-03-06T14:05:19.447 INFO:teuthology.orchestra.run.smithi003.stdout:Rotating logs: 2023-03-06T14:05:19.449 DEBUG:teuthology.orchestra.run.smithi136:> sudo service auditd rotate 2023-03-06T14:05:19.506 INFO:teuthology.orchestra.run.smithi136.stdout:Rotating logs: 2023-03-06T14:05:19.508 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-03-06T14:05:19.508 DEBUG:teuthology.orchestra.run.smithi003:> /usr/sbin/getenforce 2023-03-06T14:05:19.533 INFO:teuthology.orchestra.run.smithi003.stdout:Permissive 2023-03-06T14:05:19.534 DEBUG:teuthology.orchestra.run.smithi136:> /usr/sbin/getenforce 2023-03-06T14:05:19.560 INFO:teuthology.orchestra.run.smithi136.stdout:Permissive 2023-03-06T14:05:19.560 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi003.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi136.front.sepia.ceph.com': 'permissive'} 2023-03-06T14:05:19.561 DEBUG:teuthology.orchestra.run.smithi003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-03-06T14:05:19.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-06T14:05:19.604 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-03-06T14:05:19.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-06T14:05:19.632 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-03-06T14:05:19.632 DEBUG:teuthology.orchestra.run.smithi003:> sudo /usr/sbin/setenforce permissive 2023-03-06T14:05:19.672 DEBUG:teuthology.orchestra.run.smithi136:> sudo /usr/sbin/setenforce permissive 2023-03-06T14:05:19.700 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-03-06T14:05:19.711 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-03-06T14:05:19.711 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-03-06T14:05:19.735 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-03-06T14:05:19.736 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi003.front.sepia.ceph.com,smithi136.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-03-06T14:12:43.374 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi003.front.sepia.ceph.com'), Remote(name='ubuntu@smithi136.front.sepia.ceph.com')] 2023-03-06T14:12:43.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-03-06T14:12:43.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-06T14:12:43.447 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-03-06T14:12:43.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-03-06T14:12:43.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-06T14:12:43.582 DEBUG:teuthology.orchestra.run.smithi136:> true 2023-03-06T14:12:43.659 INFO:teuthology.run_tasks:Running task clock... 2023-03-06T14:12:43.670 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-03-06T14:12:43.670 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-06T14:12:43.671 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-06T14:12:43.673 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-06T14:12:43.674 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-06T14:12:43.706 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-03-06T14:12:43.722 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-03-06T14:12:43.731 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-03-06T14:12:43.746 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-03-06T14:12:43.802 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: ntpd: command not found 2023-03-06T14:12:43.809 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: ntpd: command not found 2023-03-06T14:12:43.814 INFO:teuthology.orchestra.run.smithi003.stdout:506 Cannot talk to daemon 2023-03-06T14:12:43.821 INFO:teuthology.orchestra.run.smithi136.stdout:506 Cannot talk to daemon 2023-03-06T14:12:43.829 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-03-06T14:12:43.835 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-03-06T14:12:43.844 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-03-06T14:12:43.848 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-03-06T14:12:43.918 INFO:teuthology.orchestra.run.smithi136.stderr:bash: ntpq: command not found 2023-03-06T14:12:43.918 INFO:teuthology.orchestra.run.smithi003.stderr:bash: ntpq: command not found 2023-03-06T14:12:43.921 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-03-06T14:12:43.921 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2023-03-06T14:12:43.921 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-06T14:12:43.921 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-06T14:12:43.921 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-06T14:12:43.922 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-06T14:12:43.923 INFO:teuthology.orchestra.run.smithi003.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-03-06T14:12:43.923 INFO:teuthology.orchestra.run.smithi003.stdout:=============================================================================== 2023-03-06T14:12:43.923 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-06T14:12:43.923 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-06T14:12:43.923 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-06T14:12:43.924 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-06T14:12:43.924 INFO:teuthology.run_tasks:Running task install... 2023-03-06T14:12:43.938 DEBUG:teuthology.task.install:project ceph 2023-03-06T14:12:43.939 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}} 2023-03-06T14:12:43.939 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'} 2023-03-06T14:12:43.939 INFO:teuthology.task.install:Using flavor: default 2023-03-06T14:12:43.945 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-03-06T14:12:43.945 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-03-06T14:12:43.946 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b', 'tag': None, 'wait_for_package': False} 2023-03-06T14:12:43.947 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-06T14:12:43.949 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b', 'tag': None, 'wait_for_package': False} 2023-03-06T14:12:43.949 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-06T14:12:44.091 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/ 2023-03-06T14:12:44.092 INFO:teuthology.task.install.rpm:Package version is 18.0.0-2739.g472aaef4 2023-03-06T14:12:44.096 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/ 2023-03-06T14:12:44.097 INFO:teuthology.task.install.rpm:Package version is 18.0.0-2739.g472aaef4 2023-03-06T14:12:44.198 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-03-06T14:12:44.199 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:12:44.199 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-03-06T14:12:44.208 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-03-06T14:12:44.209 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:12:44.209 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-03-06T14:12:44.228 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-03-06T14:12:44.228 DEBUG:teuthology.orchestra.run.smithi003:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-03-06T14:12:44.237 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-03-06T14:12:44.237 DEBUG:teuthology.orchestra.run.smithi136:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-03-06T14:12:44.300 DEBUG:teuthology.orchestra.run.smithi003:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-03-06T14:12:44.304 DEBUG:teuthology.orchestra.run.smithi136:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-03-06T14:12:44.378 DEBUG:teuthology.orchestra.run.smithi003:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-03-06T14:12:44.381 DEBUG:teuthology.orchestra.run.smithi136:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-03-06T14:12:44.446 INFO:teuthology.orchestra.run.smithi003.stdout:check_obsoletes = 1 2023-03-06T14:12:44.447 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum clean all 2023-03-06T14:12:44.449 INFO:teuthology.orchestra.run.smithi136.stdout:check_obsoletes = 1 2023-03-06T14:12:44.449 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum clean all 2023-03-06T14:12:44.818 INFO:teuthology.orchestra.run.smithi136.stdout:Updating Subscription Management repositories. 2023-03-06T14:12:44.838 INFO:teuthology.orchestra.run.smithi003.stdout:Updating Subscription Management repositories. 2023-03-06T14:12:45.064 INFO:teuthology.orchestra.run.smithi136.stdout:44 files removed 2023-03-06T14:12:45.111 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-03-06T14:12:45.126 INFO:teuthology.orchestra.run.smithi003.stdout:44 files removed 2023-03-06T14:12:45.174 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-03-06T14:12:45.441 INFO:teuthology.orchestra.run.smithi136.stdout:Updating Subscription Management repositories. 2023-03-06T14:12:45.523 INFO:teuthology.orchestra.run.smithi003.stdout:Updating Subscription Management repositories. 2023-03-06T14:12:46.084 INFO:teuthology.orchestra.run.smithi136.stdout:ceph packages for x86_64 318 kB/s | 80 kB 00:00 2023-03-06T14:12:46.312 INFO:teuthology.orchestra.run.smithi003.stdout:ceph packages for x86_64 217 kB/s | 80 kB 00:00 2023-03-06T14:12:46.334 INFO:teuthology.orchestra.run.smithi136.stdout:ceph noarch packages 43 kB/s | 9.4 kB 00:00 2023-03-06T14:12:46.571 INFO:teuthology.orchestra.run.smithi003.stdout:ceph noarch packages 42 kB/s | 9.4 kB 00:00 2023-03-06T14:12:46.585 INFO:teuthology.orchestra.run.smithi136.stdout:ceph source packages 6.5 kB/s | 1.5 kB 00:00 2023-03-06T14:12:46.736 INFO:teuthology.orchestra.run.smithi136.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-03-06T14:12:46.821 INFO:teuthology.orchestra.run.smithi003.stdout:ceph source packages 6.5 kB/s | 1.5 kB 00:00 2023-03-06T14:12:46.972 INFO:teuthology.orchestra.run.smithi003.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-03-06T14:12:47.761 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 14 MB/s | 14 MB 00:01 2023-03-06T14:12:48.047 INFO:teuthology.orchestra.run.smithi003.stdout:Extra Packages for Enterprise Linux 13 MB/s | 14 MB 00:01 2023-03-06T14:12:50.853 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 442 kB/s | 24 kB 00:00 2023-03-06T14:12:51.297 INFO:teuthology.orchestra.run.smithi003.stdout:lab-extras 434 kB/s | 24 kB 00:00 2023-03-06T14:12:51.729 INFO:teuthology.orchestra.run.smithi136.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 65 MB/s | 53 MB 00:00 2023-03-06T14:12:52.224 INFO:teuthology.orchestra.run.smithi003.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-03-06T14:12:59.830 INFO:teuthology.orchestra.run.smithi136.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-03-06T14:13:00.750 INFO:teuthology.orchestra.run.smithi003.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 55 MB/s | 47 MB 00:00 2023-03-06T14:13:10.736 INFO:teuthology.orchestra.run.smithi136.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-06T14:13:10.737 INFO:teuthology.orchestra.run.smithi136.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-06T14:13:10.752 INFO:teuthology.orchestra.run.smithi136.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-03-06T14:13:10.753 INFO:teuthology.orchestra.run.smithi136.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-03-06T14:13:10.755 INFO:teuthology.orchestra.run.smithi136.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-03-06T14:13:10.756 INFO:teuthology.orchestra.run.smithi136.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-03-06T14:13:10.758 INFO:teuthology.orchestra.run.smithi136.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-03-06T14:13:10.761 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-03-06T14:13:10.763 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-06T14:13:10.894 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2023-03-06T14:13:10.906 INFO:teuthology.orchestra.run.smithi136.stdout:=========================================================================================================================== 2023-03-06T14:13:10.907 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2023-03-06T14:13:10.907 INFO:teuthology.orchestra.run.smithi136.stdout:=========================================================================================================================== 2023-03-06T14:13:10.907 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2023-03-06T14:13:10.907 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-03-06T14:13:10.907 INFO:teuthology.orchestra.run.smithi136.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-03-06T14:13:10.907 INFO:teuthology.orchestra.run.smithi136.stdout: ceph x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 6.4 k 2023-03-06T14:13:10.907 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 5.4 M 2023-03-06T14:13:10.908 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 845 k 2023-03-06T14:13:10.908 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 166 k 2023-03-06T14:13:10.908 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 1.5 M 2023-03-06T14:13:10.908 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 123 k 2023-03-06T14:13:10.908 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 1.7 M 2023-03-06T14:13:10.908 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 7.4 M 2023-03-06T14:13:10.908 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 47 k 2023-03-06T14:13:10.909 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 13 M 2023-03-06T14:13:10.909 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 47 M 2023-03-06T14:13:10.909 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 263 k 2023-03-06T14:13:10.909 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 83 k 2023-03-06T14:13:10.910 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 257 k 2023-03-06T14:13:10.910 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 18 k 2023-03-06T14:13:10.910 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-03-06T14:13:10.910 INFO:teuthology.orchestra.run.smithi136.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-03-06T14:13:10.910 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-03-06T14:13:10.910 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 30 k 2023-03-06T14:13:10.910 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 767 k 2023-03-06T14:13:10.910 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 139 k 2023-03-06T14:13:10.911 INFO:teuthology.orchestra.run.smithi136.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-03-06T14:13:10.911 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-03-06T14:13:10.911 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-03-06T14:13:10.911 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-03-06T14:13:10.911 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-03-06T14:13:10.911 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-03-06T14:13:10.911 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 190 k 2023-03-06T14:13:10.912 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 371 k 2023-03-06T14:13:10.912 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 364 k 2023-03-06T14:13:10.912 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 107 k 2023-03-06T14:13:10.912 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 94 k 2023-03-06T14:13:10.912 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 3.4 M 2023-03-06T14:13:10.912 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 180 k 2023-03-06T14:13:10.912 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-03-06T14:13:10.912 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2023-03-06T14:13:10.913 INFO:teuthology.orchestra.run.smithi136.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-03-06T14:13:10.913 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 3.7 M 2023-03-06T14:13:10.913 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 3.6 M 2023-03-06T14:13:10.913 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2023-03-06T14:13:10.913 INFO:teuthology.orchestra.run.smithi136.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-03-06T14:13:10.913 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 22 M 2023-03-06T14:13:10.913 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 23 k 2023-03-06T14:13:10.914 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 2.3 M 2023-03-06T14:13:10.914 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 236 k 2023-03-06T14:13:10.914 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 4.6 M 2023-03-06T14:13:10.914 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 18 M 2023-03-06T14:13:10.914 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 15 k 2023-03-06T14:13:10.914 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 24 k 2023-03-06T14:13:10.914 INFO:teuthology.orchestra.run.smithi136.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-03-06T14:13:10.915 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-03-06T14:13:10.915 INFO:teuthology.orchestra.run.smithi136.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-03-06T14:13:10.915 INFO:teuthology.orchestra.run.smithi136.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-03-06T14:13:10.915 INFO:teuthology.orchestra.run.smithi136.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-03-06T14:13:10.915 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 137 k 2023-03-06T14:13:10.915 INFO:teuthology.orchestra.run.smithi136.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-03-06T14:13:10.915 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-03-06T14:13:10.916 INFO:teuthology.orchestra.run.smithi136.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-03-06T14:13:10.916 INFO:teuthology.orchestra.run.smithi136.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-03-06T14:13:10.916 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-03-06T14:13:10.916 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-03-06T14:13:10.916 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 474 k 2023-03-06T14:13:10.916 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-03-06T14:13:10.916 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 6.5 M 2023-03-06T14:13:10.916 INFO:teuthology.orchestra.run.smithi136.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-03-06T14:13:10.917 INFO:teuthology.orchestra.run.smithi136.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-03-06T14:13:10.917 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-03-06T14:13:10.917 INFO:teuthology.orchestra.run.smithi136.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-03-06T14:13:10.917 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-03-06T14:13:10.917 INFO:teuthology.orchestra.run.smithi136.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-03-06T14:13:10.917 INFO:teuthology.orchestra.run.smithi136.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-03-06T14:13:10.918 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-03-06T14:13:10.918 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-03-06T14:13:10.918 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-03-06T14:13:10.918 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-03-06T14:13:10.918 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-03-06T14:13:10.918 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-03-06T14:13:10.918 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-03-06T14:13:10.919 INFO:teuthology.orchestra.run.smithi136.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-03-06T14:13:10.919 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-03-06T14:13:10.919 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 45 k 2023-03-06T14:13:10.919 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 117 k 2023-03-06T14:13:10.919 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-03-06T14:13:10.920 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-03-06T14:13:10.920 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-03-06T14:13:10.920 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-03-06T14:13:10.920 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-03-06T14:13:10.920 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-03-06T14:13:10.920 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-03-06T14:13:10.921 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-03-06T14:13:10.921 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-03-06T14:13:10.921 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-03-06T14:13:10.921 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-03-06T14:13:10.921 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-06T14:13:10.921 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-03-06T14:13:10.921 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-03-06T14:13:10.922 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-03-06T14:13:10.922 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-03-06T14:13:10.922 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-03-06T14:13:10.922 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-03-06T14:13:10.922 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-03-06T14:13:10.922 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-03-06T14:13:10.922 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-03-06T14:13:10.923 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-03-06T14:13:10.923 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-03-06T14:13:10.923 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-03-06T14:13:10.923 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-03-06T14:13:10.923 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-03-06T14:13:10.923 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-03-06T14:13:10.924 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-03-06T14:13:10.924 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-03-06T14:13:10.924 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-03-06T14:13:10.924 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-06T14:13:10.924 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-03-06T14:13:10.924 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-03-06T14:13:10.924 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-03-06T14:13:10.925 INFO:teuthology.orchestra.run.smithi136.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-03-06T14:13:10.925 INFO:teuthology.orchestra.run.smithi136.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-03-06T14:13:10.925 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-03-06T14:13:10.925 INFO:teuthology.orchestra.run.smithi136.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-03-06T14:13:10.925 INFO:teuthology.orchestra.run.smithi136.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-03-06T14:13:10.925 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-03-06T14:13:10.925 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-03-06T14:13:10.926 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-03-06T14:13:10.926 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-03-06T14:13:10.926 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-03-06T14:13:10.926 INFO:teuthology.orchestra.run.smithi136.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-03-06T14:13:10.926 INFO:teuthology.orchestra.run.smithi136.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-03-06T14:13:10.926 INFO:teuthology.orchestra.run.smithi136.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-03-06T14:13:10.927 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-03-06T14:13:10.927 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-03-06T14:13:10.927 INFO:teuthology.orchestra.run.smithi136.stdout:Enabling module streams: 2023-03-06T14:13:10.927 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql 10 2023-03-06T14:13:10.927 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:13:10.927 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2023-03-06T14:13:10.927 INFO:teuthology.orchestra.run.smithi136.stdout:=========================================================================================================================== 2023-03-06T14:13:10.927 INFO:teuthology.orchestra.run.smithi136.stdout:Install 128 Packages 2023-03-06T14:13:10.928 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 3 Packages 2023-03-06T14:13:10.928 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:13:10.928 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 203 M 2023-03-06T14:13:10.929 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2023-03-06T14:13:11.063 INFO:teuthology.orchestra.run.smithi136.stdout:(1/131): ceph-18.0.0-2739.g472aaef4.el8.x86_64. 46 kB/s | 6.4 kB 00:00 2023-03-06T14:13:11.338 INFO:teuthology.orchestra.run.smithi136.stdout:(2/131): ceph-fuse-18.0.0-2739.g472aaef4.el8.x8 3.0 MB/s | 845 kB 00:00 2023-03-06T14:13:11.405 INFO:teuthology.orchestra.run.smithi136.stdout:(3/131): ceph-immutable-object-cache-18.0.0-273 2.4 MB/s | 166 kB 00:00 2023-03-06T14:13:11.547 INFO:teuthology.orchestra.run.smithi136.stdout:(4/131): ceph-base-18.0.0-2739.g472aaef4.el8.x8 8.6 MB/s | 5.4 MB 00:00 2023-03-06T14:13:11.739 INFO:teuthology.orchestra.run.smithi136.stdout:(5/131): ceph-mgr-18.0.0-2739.g472aaef4.el8.x86 8.1 MB/s | 1.5 MB 00:00 2023-03-06T14:13:11.914 INFO:teuthology.orchestra.run.smithi136.stdout:(6/131): ceph-mds-18.0.0-2739.g472aaef4.el8.x86 4.5 MB/s | 2.3 MB 00:00 2023-03-06T14:13:12.261 INFO:teuthology.orchestra.run.smithi136.stdout:(7/131): ceph-mon-18.0.0-2739.g472aaef4.el8.x86 8.8 MB/s | 4.6 MB 00:00 2023-03-06T14:13:12.482 INFO:teuthology.orchestra.run.smithi003.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-06T14:13:12.483 INFO:teuthology.orchestra.run.smithi003.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-06T14:13:12.498 INFO:teuthology.orchestra.run.smithi003.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-03-06T14:13:12.499 INFO:teuthology.orchestra.run.smithi003.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-03-06T14:13:12.501 INFO:teuthology.orchestra.run.smithi003.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-03-06T14:13:12.502 INFO:teuthology.orchestra.run.smithi003.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-03-06T14:13:12.504 INFO:teuthology.orchestra.run.smithi003.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-03-06T14:13:12.507 INFO:teuthology.orchestra.run.smithi003.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-03-06T14:13:12.508 INFO:teuthology.orchestra.run.smithi003.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-06T14:13:12.653 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2023-03-06T14:13:12.666 INFO:teuthology.orchestra.run.smithi003.stdout:=========================================================================================================================== 2023-03-06T14:13:12.667 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2023-03-06T14:13:12.667 INFO:teuthology.orchestra.run.smithi003.stdout:=========================================================================================================================== 2023-03-06T14:13:12.667 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2023-03-06T14:13:12.667 INFO:teuthology.orchestra.run.smithi003.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-03-06T14:13:12.667 INFO:teuthology.orchestra.run.smithi003.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-03-06T14:13:12.667 INFO:teuthology.orchestra.run.smithi003.stdout: ceph x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 6.4 k 2023-03-06T14:13:12.667 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 5.4 M 2023-03-06T14:13:12.668 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 845 k 2023-03-06T14:13:12.668 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 166 k 2023-03-06T14:13:12.668 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 1.5 M 2023-03-06T14:13:12.668 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-cephadm noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 123 k 2023-03-06T14:13:12.668 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 1.7 M 2023-03-06T14:13:12.668 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 7.4 M 2023-03-06T14:13:12.668 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 47 k 2023-03-06T14:13:12.669 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 13 M 2023-03-06T14:13:12.669 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 47 M 2023-03-06T14:13:12.669 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-volume noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 263 k 2023-03-06T14:13:12.669 INFO:teuthology.orchestra.run.smithi003.stdout: cephadm noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 83 k 2023-03-06T14:13:12.669 INFO:teuthology.orchestra.run.smithi003.stdout: cephfs-mirror x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 257 k 2023-03-06T14:13:12.669 INFO:teuthology.orchestra.run.smithi003.stdout: cephfs-top noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 18 k 2023-03-06T14:13:12.669 INFO:teuthology.orchestra.run.smithi003.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-03-06T14:13:12.669 INFO:teuthology.orchestra.run.smithi003.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-03-06T14:13:12.670 INFO:teuthology.orchestra.run.smithi003.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-03-06T14:13:12.670 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 30 k 2023-03-06T14:13:12.670 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 767 k 2023-03-06T14:13:12.670 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 139 k 2023-03-06T14:13:12.670 INFO:teuthology.orchestra.run.smithi003.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-03-06T14:13:12.670 INFO:teuthology.orchestra.run.smithi003.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-03-06T14:13:12.670 INFO:teuthology.orchestra.run.smithi003.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-03-06T14:13:12.671 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-03-06T14:13:12.671 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-03-06T14:13:12.671 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-03-06T14:13:12.671 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 190 k 2023-03-06T14:13:12.671 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 371 k 2023-03-06T14:13:12.671 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 364 k 2023-03-06T14:13:12.671 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 107 k 2023-03-06T14:13:12.671 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 94 k 2023-03-06T14:13:12.672 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 3.4 M 2023-03-06T14:13:12.672 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 180 k 2023-03-06T14:13:12.672 INFO:teuthology.orchestra.run.smithi003.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-03-06T14:13:12.672 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrading: 2023-03-06T14:13:12.672 INFO:teuthology.orchestra.run.smithi003.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-03-06T14:13:12.672 INFO:teuthology.orchestra.run.smithi003.stdout: librados2 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 3.7 M 2023-03-06T14:13:12.672 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 3.6 M 2023-03-06T14:13:12.673 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2023-03-06T14:13:12.673 INFO:teuthology.orchestra.run.smithi003.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-03-06T14:13:12.673 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 22 M 2023-03-06T14:13:12.673 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 23 k 2023-03-06T14:13:12.673 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 2.3 M 2023-03-06T14:13:12.673 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 236 k 2023-03-06T14:13:12.673 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 4.6 M 2023-03-06T14:13:12.674 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 18 M 2023-03-06T14:13:12.674 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-prometheus-alerts noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 15 k 2023-03-06T14:13:12.674 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 24 k 2023-03-06T14:13:12.674 INFO:teuthology.orchestra.run.smithi003.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-03-06T14:13:12.674 INFO:teuthology.orchestra.run.smithi003.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-03-06T14:13:12.674 INFO:teuthology.orchestra.run.smithi003.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-03-06T14:13:12.674 INFO:teuthology.orchestra.run.smithi003.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-03-06T14:13:12.674 INFO:teuthology.orchestra.run.smithi003.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-03-06T14:13:12.675 INFO:teuthology.orchestra.run.smithi003.stdout: libcephsqlite x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 137 k 2023-03-06T14:13:12.675 INFO:teuthology.orchestra.run.smithi003.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-03-06T14:13:12.675 INFO:teuthology.orchestra.run.smithi003.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-03-06T14:13:12.675 INFO:teuthology.orchestra.run.smithi003.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-03-06T14:13:12.675 INFO:teuthology.orchestra.run.smithi003.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-03-06T14:13:12.675 INFO:teuthology.orchestra.run.smithi003.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-03-06T14:13:12.675 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-03-06T14:13:12.676 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 474 k 2023-03-06T14:13:12.676 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-03-06T14:13:12.676 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 6.5 M 2023-03-06T14:13:12.676 INFO:teuthology.orchestra.run.smithi003.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-03-06T14:13:12.676 INFO:teuthology.orchestra.run.smithi003.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-03-06T14:13:12.676 INFO:teuthology.orchestra.run.smithi003.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-03-06T14:13:12.676 INFO:teuthology.orchestra.run.smithi003.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-03-06T14:13:12.677 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-03-06T14:13:12.677 INFO:teuthology.orchestra.run.smithi003.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-03-06T14:13:12.677 INFO:teuthology.orchestra.run.smithi003.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-03-06T14:13:12.677 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-03-06T14:13:12.677 INFO:teuthology.orchestra.run.smithi003.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-03-06T14:13:12.677 INFO:teuthology.orchestra.run.smithi003.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-03-06T14:13:12.677 INFO:teuthology.orchestra.run.smithi003.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-03-06T14:13:12.677 INFO:teuthology.orchestra.run.smithi003.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-03-06T14:13:12.678 INFO:teuthology.orchestra.run.smithi003.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-03-06T14:13:12.678 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-03-06T14:13:12.678 INFO:teuthology.orchestra.run.smithi003.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-03-06T14:13:12.678 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-03-06T14:13:12.678 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 45 k 2023-03-06T14:13:12.678 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-common x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 117 k 2023-03-06T14:13:12.678 INFO:teuthology.orchestra.run.smithi003.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-03-06T14:13:12.678 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-03-06T14:13:12.679 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-03-06T14:13:12.679 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-03-06T14:13:12.679 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-03-06T14:13:12.679 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-03-06T14:13:12.679 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-03-06T14:13:12.679 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-03-06T14:13:12.679 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-03-06T14:13:12.680 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-03-06T14:13:12.680 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-03-06T14:13:12.680 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-06T14:13:12.680 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-03-06T14:13:12.680 INFO:teuthology.orchestra.run.smithi003.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-03-06T14:13:12.680 INFO:teuthology.orchestra.run.smithi003.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-03-06T14:13:12.680 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-03-06T14:13:12.680 INFO:teuthology.orchestra.run.smithi003.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-03-06T14:13:12.681 INFO:teuthology.orchestra.run.smithi003.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-03-06T14:13:12.681 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-03-06T14:13:12.681 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-03-06T14:13:12.681 INFO:teuthology.orchestra.run.smithi003.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-03-06T14:13:12.681 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-03-06T14:13:12.681 INFO:teuthology.orchestra.run.smithi003.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-03-06T14:13:12.681 INFO:teuthology.orchestra.run.smithi003.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-03-06T14:13:12.682 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-03-06T14:13:12.682 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-03-06T14:13:12.682 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-03-06T14:13:12.682 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-03-06T14:13:12.682 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-03-06T14:13:12.682 INFO:teuthology.orchestra.run.smithi003.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-03-06T14:13:12.682 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-06T14:13:12.682 INFO:teuthology.orchestra.run.smithi003.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-03-06T14:13:12.683 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-03-06T14:13:12.683 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-03-06T14:13:12.683 INFO:teuthology.orchestra.run.smithi003.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-03-06T14:13:12.683 INFO:teuthology.orchestra.run.smithi003.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-03-06T14:13:12.683 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-03-06T14:13:12.683 INFO:teuthology.orchestra.run.smithi003.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-03-06T14:13:12.683 INFO:teuthology.orchestra.run.smithi003.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-03-06T14:13:12.684 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-03-06T14:13:12.684 INFO:teuthology.orchestra.run.smithi003.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-03-06T14:13:12.684 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-03-06T14:13:12.684 INFO:teuthology.orchestra.run.smithi003.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-03-06T14:13:12.684 INFO:teuthology.orchestra.run.smithi003.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-03-06T14:13:12.684 INFO:teuthology.orchestra.run.smithi003.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-03-06T14:13:12.684 INFO:teuthology.orchestra.run.smithi003.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-03-06T14:13:12.685 INFO:teuthology.orchestra.run.smithi003.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-03-06T14:13:12.685 INFO:teuthology.orchestra.run.smithi003.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-03-06T14:13:12.685 INFO:teuthology.orchestra.run.smithi003.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-03-06T14:13:12.685 INFO:teuthology.orchestra.run.smithi003.stdout:Enabling module streams: 2023-03-06T14:13:12.685 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql 10 2023-03-06T14:13:12.685 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:13:12.685 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2023-03-06T14:13:12.685 INFO:teuthology.orchestra.run.smithi003.stdout:=========================================================================================================================== 2023-03-06T14:13:12.686 INFO:teuthology.orchestra.run.smithi003.stdout:Install 128 Packages 2023-03-06T14:13:12.686 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrade 3 Packages 2023-03-06T14:13:12.686 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:13:12.686 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 203 M 2023-03-06T14:13:12.687 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2023-03-06T14:13:12.765 INFO:teuthology.orchestra.run.smithi136.stdout:(8/131): ceph-common-18.0.0-2739.g472aaef4.el8. 12 MB/s | 22 MB 00:01 2023-03-06T14:13:12.808 INFO:teuthology.orchestra.run.smithi003.stdout:(1/131): ceph-18.0.0-2739.g472aaef4.el8.x86_64. 52 kB/s | 6.4 kB 00:00 2023-03-06T14:13:12.823 INFO:teuthology.orchestra.run.smithi136.stdout:(9/131): ceph-selinux-18.0.0-2739.g472aaef4.el8 418 kB/s | 24 kB 00:00 2023-03-06T14:13:13.540 INFO:teuthology.orchestra.run.smithi136.stdout:(10/131): ceph-radosgw-18.0.0-2739.g472aaef4.el 10 MB/s | 13 MB 00:01 2023-03-06T14:13:13.600 INFO:teuthology.orchestra.run.smithi003.stdout:(2/131): ceph-fuse-18.0.0-2739.g472aaef4.el8.x8 1.0 MB/s | 845 kB 00:00 2023-03-06T14:13:13.623 INFO:teuthology.orchestra.run.smithi136.stdout:(11/131): cephfs-mirror-18.0.0-2739.g472aaef4.e 3.0 MB/s | 257 kB 00:00 2023-03-06T14:13:13.707 INFO:teuthology.orchestra.run.smithi136.stdout:(12/131): libcephfs-devel-18.0.0-2739.g472aaef4 366 kB/s | 30 kB 00:00 2023-03-06T14:13:13.734 INFO:teuthology.orchestra.run.smithi003.stdout:(3/131): ceph-immutable-object-cache-18.0.0-273 1.2 MB/s | 166 kB 00:00 2023-03-06T14:13:14.049 INFO:teuthology.orchestra.run.smithi136.stdout:(13/131): libcephfs2-18.0.0-2739.g472aaef4.el8. 2.2 MB/s | 767 kB 00:00 2023-03-06T14:13:14.133 INFO:teuthology.orchestra.run.smithi136.stdout:(14/131): libcephsqlite-18.0.0-2739.g472aaef4.e 1.6 MB/s | 137 kB 00:00 2023-03-06T14:13:14.208 INFO:teuthology.orchestra.run.smithi136.stdout:(15/131): librados-devel-18.0.0-2739.g472aaef4. 1.8 MB/s | 139 kB 00:00 2023-03-06T14:13:14.334 INFO:teuthology.orchestra.run.smithi136.stdout:(16/131): libradosstriper1-18.0.0-2739.g472aaef 3.7 MB/s | 474 kB 00:00 2023-03-06T14:13:15.284 INFO:teuthology.orchestra.run.smithi003.stdout:(4/131): ceph-mds-18.0.0-2739.g472aaef4.el8.x86 1.5 MB/s | 2.3 MB 00:01 2023-03-06T14:13:15.351 INFO:teuthology.orchestra.run.smithi136.stdout:(17/131): ceph-osd-18.0.0-2739.g472aaef4.el8.x8 5.1 MB/s | 18 MB 00:03 2023-03-06T14:13:15.442 INFO:teuthology.orchestra.run.smithi136.stdout:(18/131): librgw2-18.0.0-2739.g472aaef4.el8.x86 5.9 MB/s | 6.5 MB 00:01 2023-03-06T14:13:15.460 INFO:teuthology.orchestra.run.smithi136.stdout:(19/131): python3-ceph-argparse-18.0.0-2739.g47 412 kB/s | 45 kB 00:00 2023-03-06T14:13:15.501 INFO:teuthology.orchestra.run.smithi136.stdout:(20/131): python3-ceph-common-18.0.0-2739.g472a 2.0 MB/s | 117 kB 00:00 2023-03-06T14:13:15.535 INFO:teuthology.orchestra.run.smithi136.stdout:(21/131): python3-cephfs-18.0.0-2739.g472aaef4. 2.5 MB/s | 190 kB 00:00 2023-03-06T14:13:15.652 INFO:teuthology.orchestra.run.smithi136.stdout:(22/131): python3-rbd-18.0.0-2739.g472aaef4.el8 3.0 MB/s | 364 kB 00:00 2023-03-06T14:13:15.678 INFO:teuthology.orchestra.run.smithi136.stdout:(23/131): python3-rados-18.0.0-2739.g472aaef4.e 2.1 MB/s | 371 kB 00:00 2023-03-06T14:13:15.727 INFO:teuthology.orchestra.run.smithi136.stdout:(24/131): python3-rgw-18.0.0-2739.g472aaef4.el8 1.4 MB/s | 107 kB 00:00 2023-03-06T14:13:15.761 INFO:teuthology.orchestra.run.smithi136.stdout:(25/131): rbd-fuse-18.0.0-2739.g472aaef4.el8.x8 1.1 MB/s | 94 kB 00:00 2023-03-06T14:13:15.870 INFO:teuthology.orchestra.run.smithi136.stdout:(26/131): rbd-nbd-18.0.0-2739.g472aaef4.el8.x86 1.6 MB/s | 180 kB 00:00 2023-03-06T14:13:15.953 INFO:teuthology.orchestra.run.smithi136.stdout:(27/131): ceph-grafana-dashboards-18.0.0-2739.g 276 kB/s | 23 kB 00:00 2023-03-06T14:13:16.054 INFO:teuthology.orchestra.run.smithi136.stdout:(28/131): ceph-mgr-cephadm-18.0.0-2739.g472aaef 1.2 MB/s | 123 kB 00:00 2023-03-06T14:13:16.076 INFO:teuthology.orchestra.run.smithi003.stdout:(5/131): ceph-base-18.0.0-2739.g472aaef4.el8.x8 1.6 MB/s | 5.4 MB 00:03 2023-03-06T14:13:16.193 INFO:teuthology.orchestra.run.smithi003.stdout:(6/131): ceph-mgr-18.0.0-2739.g472aaef4.el8.x86 1.7 MB/s | 1.5 MB 00:00 2023-03-06T14:13:16.387 INFO:teuthology.orchestra.run.smithi136.stdout:(29/131): ceph-mgr-dashboard-18.0.0-2739.g472aa 5.2 MB/s | 1.7 MB 00:00 2023-03-06T14:13:16.454 INFO:teuthology.orchestra.run.smithi136.stdout:(30/131): rbd-mirror-18.0.0-2739.g472aaef4.el8. 4.7 MB/s | 3.4 MB 00:00 2023-03-06T14:13:16.554 INFO:teuthology.orchestra.run.smithi136.stdout:(31/131): ceph-mgr-modules-core-18.0.0-2739.g47 2.3 MB/s | 236 kB 00:00 2023-03-06T14:13:16.638 INFO:teuthology.orchestra.run.smithi136.stdout:(32/131): ceph-mgr-rook-18.0.0-2739.g472aaef4.e 568 kB/s | 47 kB 00:00 2023-03-06T14:13:17.064 INFO:teuthology.orchestra.run.smithi136.stdout:(33/131): ceph-test-18.0.0-2739.g472aaef4.el8.x 11 MB/s | 47 MB 00:04 2023-03-06T14:13:17.089 INFO:teuthology.orchestra.run.smithi136.stdout:(34/131): ceph-prometheus-alerts-18.0.0-2739.g4 32 kB/s | 15 kB 00:00 2023-03-06T14:13:17.101 INFO:teuthology.orchestra.run.smithi003.stdout:(7/131): ceph-common-18.0.0-2739.g472aaef4.el8. 4.9 MB/s | 22 MB 00:04 2023-03-06T14:13:17.147 INFO:teuthology.orchestra.run.smithi136.stdout:(35/131): ceph-volume-18.0.0-2739.g472aaef4.el8 3.1 MB/s | 263 kB 00:00 2023-03-06T14:13:17.173 INFO:teuthology.orchestra.run.smithi136.stdout:(36/131): cephadm-18.0.0-2739.g472aaef4.el8.noa 990 kB/s | 83 kB 00:00 2023-03-06T14:13:17.214 INFO:teuthology.orchestra.run.smithi136.stdout:(37/131): cephfs-top-18.0.0-2739.g472aaef4.el8. 270 kB/s | 18 kB 00:00 2023-03-06T14:13:17.365 INFO:teuthology.orchestra.run.smithi136.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 392 kB/s | 59 kB 00:00 2023-03-06T14:13:17.390 INFO:teuthology.orchestra.run.smithi136.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2023-03-06T14:13:17.482 INFO:teuthology.orchestra.run.smithi136.stdout:(40/131): ceph-mgr-diskprediction-local-18.0.0- 6.8 MB/s | 7.4 MB 00:01 2023-03-06T14:13:17.507 INFO:teuthology.orchestra.run.smithi136.stdout:(41/131): libunwind-1.3.1-3.el8.x86_64.rpm 528 kB/s | 75 kB 00:00 2023-03-06T14:13:17.533 INFO:teuthology.orchestra.run.smithi136.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.3 MB/s | 476 kB 00:00 2023-03-06T14:13:17.591 INFO:teuthology.orchestra.run.smithi136.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 564 kB/s | 33 kB 00:00 2023-03-06T14:13:17.617 INFO:teuthology.orchestra.run.smithi136.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.7 MB/s | 185 kB 00:00 2023-03-06T14:13:17.634 INFO:teuthology.orchestra.run.smithi136.stdout:(45/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 288 kB/s | 44 kB 00:00 2023-03-06T14:13:17.651 INFO:teuthology.orchestra.run.smithi136.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 277 kB/s | 16 kB 00:00 2023-03-06T14:13:17.676 INFO:teuthology.orchestra.run.smithi136.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.9 MB/s | 173 kB 00:00 2023-03-06T14:13:17.701 INFO:teuthology.orchestra.run.smithi136.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-03-06T14:13:17.719 INFO:teuthology.orchestra.run.smithi136.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 266 kB/s | 11 kB 00:00 2023-03-06T14:13:17.743 INFO:teuthology.orchestra.run.smithi136.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 419 kB/s | 18 kB 00:00 2023-03-06T14:13:17.769 INFO:teuthology.orchestra.run.smithi136.stdout:(51/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.8 MB/s | 384 kB 00:00 2023-03-06T14:13:17.785 INFO:teuthology.orchestra.run.smithi136.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 1.1 MB/s | 49 kB 00:00 2023-03-06T14:13:17.811 INFO:teuthology.orchestra.run.smithi136.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 1.4 MB/s | 59 kB 00:00 2023-03-06T14:13:17.828 INFO:teuthology.orchestra.run.smithi136.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2023-03-06T14:13:17.870 INFO:teuthology.orchestra.run.smithi136.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2023-03-06T14:13:17.895 INFO:teuthology.orchestra.run.smithi136.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2023-03-06T14:13:17.929 INFO:teuthology.orchestra.run.smithi136.stdout:(57/131): python3-kubernetes-11.0.0-6.el8.noarc 5.5 MB/s | 1.2 MB 00:00 2023-03-06T14:13:17.952 INFO:teuthology.orchestra.run.smithi003.stdout:(8/131): ceph-radosgw-18.0.0-2739.g472aaef4.el8 15 MB/s | 13 MB 00:00 2023-03-06T14:13:17.954 INFO:teuthology.orchestra.run.smithi136.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 401 kB/s | 34 kB 00:00 2023-03-06T14:13:17.979 INFO:teuthology.orchestra.run.smithi136.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 2.3 MB/s | 196 kB 00:00 2023-03-06T14:13:17.993 INFO:teuthology.orchestra.run.smithi003.stdout:(9/131): ceph-selinux-18.0.0-2739.g472aaef4.el8 590 kB/s | 24 kB 00:00 2023-03-06T14:13:18.005 INFO:teuthology.orchestra.run.smithi136.stdout:(60/131): python3-rsa-4.8-1.el8.noarch.rpm 814 kB/s | 61 kB 00:00 2023-03-06T14:13:18.030 INFO:teuthology.orchestra.run.smithi136.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 248 kB/s | 19 kB 00:00 2023-03-06T14:13:18.055 INFO:teuthology.orchestra.run.smithi136.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 316 kB/s | 24 kB 00:00 2023-03-06T14:13:18.080 INFO:teuthology.orchestra.run.smithi136.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 388 kB/s | 29 kB 00:00 2023-03-06T14:13:18.102 INFO:teuthology.orchestra.run.smithi003.stdout:(10/131): ceph-mon-18.0.0-2739.g472aaef4.el8.x8 2.3 MB/s | 4.6 MB 00:02 2023-03-06T14:13:18.105 INFO:teuthology.orchestra.run.smithi136.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 365 kB/s | 27 kB 00:00 2023-03-06T14:13:18.131 INFO:teuthology.orchestra.run.smithi136.stdout:(65/131): python3-waitress-1.2.1-2.el8.1.noarch 3.1 MB/s | 241 kB 00:00 2023-03-06T14:13:18.156 INFO:teuthology.orchestra.run.smithi136.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 3.2 MB/s | 251 kB 00:00 2023-03-06T14:13:18.181 INFO:teuthology.orchestra.run.smithi136.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 811 kB/s | 61 kB 00:00 2023-03-06T14:13:18.207 INFO:teuthology.orchestra.run.smithi136.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-03-06T14:13:18.211 INFO:teuthology.orchestra.run.smithi003.stdout:(11/131): cephfs-mirror-18.0.0-2739.g472aaef4.e 2.3 MB/s | 257 kB 00:00 2023-03-06T14:13:18.232 INFO:teuthology.orchestra.run.smithi136.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 304 kB/s | 23 kB 00:00 2023-03-06T14:13:18.257 INFO:teuthology.orchestra.run.smithi136.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-03-06T14:13:18.269 INFO:teuthology.orchestra.run.smithi003.stdout:(12/131): libcephfs-devel-18.0.0-2739.g472aaef4 525 kB/s | 30 kB 00:00 2023-03-06T14:13:18.307 INFO:teuthology.orchestra.run.smithi136.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 625 kB/s | 47 kB 00:00 2023-03-06T14:13:18.333 INFO:teuthology.orchestra.run.smithi136.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.8 MB/s | 200 kB 00:00 2023-03-06T14:13:18.358 INFO:teuthology.orchestra.run.smithi136.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 845 kB/s | 43 kB 00:00 2023-03-06T14:13:18.408 INFO:teuthology.orchestra.run.smithi136.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.9 MB/s | 220 kB 00:00 2023-03-06T14:13:18.434 INFO:teuthology.orchestra.run.smithi136.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 639 kB/s | 48 kB 00:00 2023-03-06T14:13:18.467 INFO:teuthology.orchestra.run.smithi136.stdout:(76/131): thrift-0.13.0-2.el8.x86_64.rpm 6.1 MB/s | 1.7 MB 00:00 2023-03-06T14:13:18.493 INFO:teuthology.orchestra.run.smithi136.stdout:(77/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2023-03-06T14:13:18.520 INFO:teuthology.orchestra.run.smithi003.stdout:(13/131): libcephfs2-18.0.0-2739.g472aaef4.el8. 3.0 MB/s | 767 kB 00:00 2023-03-06T14:13:18.526 INFO:teuthology.orchestra.run.smithi136.stdout:(78/131): python3-requests-oauthlib-1.0.0-1.el8 463 kB/s | 43 kB 00:00 2023-03-06T14:13:18.544 INFO:teuthology.orchestra.run.smithi136.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-03-06T14:13:18.570 INFO:teuthology.orchestra.run.smithi136.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.2 MB/s | 229 kB 00:00 2023-03-06T14:13:18.594 INFO:teuthology.orchestra.run.smithi136.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 372 kB/s | 19 kB 00:00 2023-03-06T14:13:18.619 INFO:teuthology.orchestra.run.smithi136.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-03-06T14:13:18.620 INFO:teuthology.orchestra.run.smithi003.stdout:(14/131): libcephsqlite-18.0.0-2739.g472aaef4.e 1.3 MB/s | 137 kB 00:00 2023-03-06T14:13:18.653 INFO:teuthology.orchestra.run.smithi136.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.4 MB/s | 560 kB 00:00 2023-03-06T14:13:18.670 INFO:teuthology.orchestra.run.smithi136.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 358 kB/s | 18 kB 00:00 2023-03-06T14:13:18.703 INFO:teuthology.orchestra.run.smithi136.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 5.0 MB/s | 559 kB 00:00 2023-03-06T14:13:18.720 INFO:teuthology.orchestra.run.smithi003.stdout:(15/131): librados-devel-18.0.0-2739.g472aaef4. 1.4 MB/s | 139 kB 00:00 2023-03-06T14:13:18.728 INFO:teuthology.orchestra.run.smithi136.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-03-06T14:13:18.754 INFO:teuthology.orchestra.run.smithi136.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.9 MB/s | 605 kB 00:00 2023-03-06T14:13:18.779 INFO:teuthology.orchestra.run.smithi136.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-03-06T14:13:18.813 INFO:teuthology.orchestra.run.smithi136.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2023-03-06T14:13:18.838 INFO:teuthology.orchestra.run.smithi136.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.0 MB/s | 60 kB 00:00 2023-03-06T14:13:18.863 INFO:teuthology.orchestra.run.smithi136.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-03-06T14:13:18.880 INFO:teuthology.orchestra.run.smithi136.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2023-03-06T14:13:18.896 INFO:teuthology.orchestra.run.smithi003.stdout:(16/131): libradosstriper1-18.0.0-2739.g472aaef 2.6 MB/s | 474 kB 00:00 2023-03-06T14:13:18.897 INFO:teuthology.orchestra.run.smithi136.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 1.1 MB/s | 39 kB 00:00 2023-03-06T14:13:18.931 INFO:teuthology.orchestra.run.smithi136.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 13 MB/s | 644 kB 00:00 2023-03-06T14:13:18.987 INFO:teuthology.orchestra.run.smithi136.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.9 MB/s | 171 kB 00:00 2023-03-06T14:13:19.140 INFO:teuthology.orchestra.run.smithi136.stdout:(96/131): NetworkManager-initscripts-updown-1.3 660 kB/s | 138 kB 00:00 2023-03-06T14:13:19.198 INFO:teuthology.orchestra.run.smithi136.stdout:(97/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 4.7 MB/s | 2.3 MB 00:00 2023-03-06T14:13:19.215 INFO:teuthology.orchestra.run.smithi136.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2023-03-06T14:13:19.241 INFO:teuthology.orchestra.run.smithi136.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-03-06T14:13:19.266 INFO:teuthology.orchestra.run.smithi136.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2023-03-06T14:13:19.300 INFO:teuthology.orchestra.run.smithi136.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-03-06T14:13:19.325 INFO:teuthology.orchestra.run.smithi136.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 662 kB/s | 39 kB 00:00 2023-03-06T14:13:19.367 INFO:teuthology.orchestra.run.smithi136.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-03-06T14:13:19.409 INFO:teuthology.orchestra.run.smithi136.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 6.3 MB/s | 538 kB 00:00 2023-03-06T14:13:19.434 INFO:teuthology.orchestra.run.smithi136.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-03-06T14:13:19.460 INFO:teuthology.orchestra.run.smithi136.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-03-06T14:13:19.502 INFO:teuthology.orchestra.run.smithi136.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-03-06T14:13:19.544 INFO:teuthology.orchestra.run.smithi136.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 639 kB/s | 27 kB 00:00 2023-03-06T14:13:19.585 INFO:teuthology.orchestra.run.smithi136.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-03-06T14:13:19.611 INFO:teuthology.orchestra.run.smithi136.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.7 MB/s | 44 kB 00:00 2023-03-06T14:13:19.703 INFO:teuthology.orchestra.run.smithi136.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-03-06T14:13:19.745 INFO:teuthology.orchestra.run.smithi136.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2023-03-06T14:13:19.787 INFO:teuthology.orchestra.run.smithi136.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-03-06T14:13:19.853 INFO:teuthology.orchestra.run.smithi136.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 15 MB/s | 3.7 MB 00:00 2023-03-06T14:13:19.871 INFO:teuthology.orchestra.run.smithi136.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 767 kB/s | 64 kB 00:00 2023-03-06T14:13:19.896 INFO:teuthology.orchestra.run.smithi136.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.9 MB/s | 126 kB 00:00 2023-03-06T14:13:19.913 INFO:teuthology.orchestra.run.smithi136.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 479 kB/s | 20 kB 00:00 2023-03-06T14:13:19.938 INFO:teuthology.orchestra.run.smithi136.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.4 MB/s | 103 kB 00:00 2023-03-06T14:13:19.980 INFO:teuthology.orchestra.run.smithi136.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-03-06T14:13:20.138 INFO:teuthology.orchestra.run.smithi136.stdout:(120/131): python3-scipy-1.0.0-21.module+el8.5. 12 MB/s | 14 MB 00:01 2023-03-06T14:13:20.164 INFO:teuthology.orchestra.run.smithi136.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.1 MB/s | 198 kB 00:00 2023-03-06T14:13:20.206 INFO:teuthology.orchestra.run.smithi136.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-03-06T14:13:20.248 INFO:teuthology.orchestra.run.smithi136.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-03-06T14:13:20.331 INFO:teuthology.orchestra.run.smithi136.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 12 MB/s | 4.9 MB 00:00 2023-03-06T14:13:20.423 INFO:teuthology.orchestra.run.smithi136.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-03-06T14:13:20.474 INFO:teuthology.orchestra.run.smithi136.stdout:(126/131): postgresql-contrib-10.21-2.module+el 5.6 MB/s | 808 kB 00:00 2023-03-06T14:13:20.532 INFO:teuthology.orchestra.run.smithi136.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 14 MB/s | 1.5 MB 00:00 2023-03-06T14:13:20.608 INFO:teuthology.orchestra.run.smithi136.stdout:(128/131): postgresql-server-10.21-2.module+el8 14 MB/s | 5.1 MB 00:00 2023-03-06T14:13:20.658 INFO:teuthology.orchestra.run.smithi136.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-03-06T14:13:20.804 INFO:teuthology.orchestra.run.smithi003.stdout:(17/131): ceph-test-18.0.0-2739.g472aaef4.el8.x 17 MB/s | 47 MB 00:02 2023-03-06T14:13:20.914 INFO:teuthology.orchestra.run.smithi003.stdout:(18/131): librgw2-18.0.0-2739.g472aaef4.el8.x86 3.2 MB/s | 6.5 MB 00:02 2023-03-06T14:13:20.933 INFO:teuthology.orchestra.run.smithi136.stdout:(130/131): librbd1-18.0.0-2739.g472aaef4.el8.x8 8.9 MB/s | 3.6 MB 00:00 2023-03-06T14:13:20.946 INFO:teuthology.orchestra.run.smithi003.stdout:(19/131): python3-ceph-argparse-18.0.0-2739.g47 314 kB/s | 45 kB 00:00 2023-03-06T14:13:20.983 INFO:teuthology.orchestra.run.smithi136.stdout:(131/131): librados2-18.0.0-2739.g472aaef4.el8. 7.2 MB/s | 3.7 MB 00:00 2023-03-06T14:13:20.985 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2023-03-06T14:13:20.986 INFO:teuthology.orchestra.run.smithi136.stdout:Total 20 MB/s | 203 MB 00:10 2023-03-06T14:13:21.130 INFO:teuthology.orchestra.run.smithi003.stdout:(20/131): ceph-osd-18.0.0-2739.g472aaef4.el8.x8 3.6 MB/s | 18 MB 00:04 2023-03-06T14:13:21.155 INFO:teuthology.orchestra.run.smithi003.stdout:(21/131): python3-ceph-common-18.0.0-2739.g472a 484 kB/s | 117 kB 00:00 2023-03-06T14:13:21.181 INFO:teuthology.orchestra.run.smithi003.stdout:(22/131): python3-cephfs-18.0.0-2739.g472aaef4. 814 kB/s | 190 kB 00:00 2023-03-06T14:13:21.231 INFO:teuthology.orchestra.run.smithi003.stdout:(23/131): python3-rgw-18.0.0-2739.g472aaef4.el8 2.1 MB/s | 107 kB 00:00 2023-03-06T14:13:21.256 INFO:teuthology.orchestra.run.smithi003.stdout:(24/131): python3-rados-18.0.0-2739.g472aaef4.e 2.9 MB/s | 371 kB 00:00 2023-03-06T14:13:21.281 INFO:teuthology.orchestra.run.smithi003.stdout:(25/131): python3-rbd-18.0.0-2739.g472aaef4.el8 2.8 MB/s | 364 kB 00:00 2023-03-06T14:13:21.307 INFO:teuthology.orchestra.run.smithi003.stdout:(26/131): rbd-fuse-18.0.0-2739.g472aaef4.el8.x8 1.2 MB/s | 94 kB 00:00 2023-03-06T14:13:21.349 INFO:teuthology.orchestra.run.smithi003.stdout:(27/131): rbd-nbd-18.0.0-2739.g472aaef4.el8.x86 2.6 MB/s | 180 kB 00:00 2023-03-06T14:13:21.365 INFO:teuthology.orchestra.run.smithi003.stdout:(28/131): ceph-grafana-dashboards-18.0.0-2739.g 395 kB/s | 23 kB 00:00 2023-03-06T14:13:21.399 INFO:teuthology.orchestra.run.smithi003.stdout:(29/131): ceph-mgr-cephadm-18.0.0-2739.g472aaef 2.4 MB/s | 123 kB 00:00 2023-03-06T14:13:21.524 INFO:teuthology.orchestra.run.smithi003.stdout:(30/131): ceph-mgr-dashboard-18.0.0-2739.g472aa 11 MB/s | 1.7 MB 00:00 2023-03-06T14:13:21.583 INFO:teuthology.orchestra.run.smithi003.stdout:(31/131): ceph-mgr-modules-core-18.0.0-2739.g47 4.0 MB/s | 236 kB 00:00 2023-03-06T14:13:21.625 INFO:teuthology.orchestra.run.smithi003.stdout:(32/131): ceph-mgr-rook-18.0.0-2739.g472aaef4.e 1.1 MB/s | 47 kB 00:00 2023-03-06T14:13:21.692 INFO:teuthology.orchestra.run.smithi003.stdout:(33/131): ceph-prometheus-alerts-18.0.0-2739.g4 218 kB/s | 15 kB 00:00 2023-03-06T14:13:21.750 INFO:teuthology.orchestra.run.smithi003.stdout:(34/131): ceph-volume-18.0.0-2739.g472aaef4.el8 4.4 MB/s | 263 kB 00:00 2023-03-06T14:13:21.801 INFO:teuthology.orchestra.run.smithi003.stdout:(35/131): rbd-mirror-18.0.0-2739.g472aaef4.el8. 6.3 MB/s | 3.4 MB 00:00 2023-03-06T14:13:21.818 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2023-03-06T14:13:21.843 INFO:teuthology.orchestra.run.smithi003.stdout:(36/131): cephadm-18.0.0-2739.g472aaef4.el8.noa 901 kB/s | 83 kB 00:00 2023-03-06T14:13:21.868 INFO:teuthology.orchestra.run.smithi003.stdout:(37/131): cephfs-top-18.0.0-2739.g472aaef4.el8. 271 kB/s | 18 kB 00:00 2023-03-06T14:13:21.938 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2023-03-06T14:13:21.938 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2023-03-06T14:13:22.019 INFO:teuthology.orchestra.run.smithi003.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 391 kB/s | 59 kB 00:00 2023-03-06T14:13:22.102 INFO:teuthology.orchestra.run.smithi003.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 903 kB/s | 75 kB 00:00 2023-03-06T14:13:22.127 INFO:teuthology.orchestra.run.smithi003.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-03-06T14:13:22.177 INFO:teuthology.orchestra.run.smithi003.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 875 kB/s | 44 kB 00:00 2023-03-06T14:13:22.245 INFO:teuthology.orchestra.run.smithi003.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.3 MB/s | 476 kB 00:00 2023-03-06T14:13:22.270 INFO:teuthology.orchestra.run.smithi003.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.0 MB/s | 185 kB 00:00 2023-03-06T14:13:22.295 INFO:teuthology.orchestra.run.smithi003.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 657 kB/s | 33 kB 00:00 2023-03-06T14:13:22.320 INFO:teuthology.orchestra.run.smithi003.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 325 kB/s | 16 kB 00:00 2023-03-06T14:13:22.346 INFO:teuthology.orchestra.run.smithi003.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2023-03-06T14:13:22.397 INFO:teuthology.orchestra.run.smithi003.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-03-06T14:13:22.452 INFO:teuthology.orchestra.run.smithi003.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.9 MB/s | 384 kB 00:00 2023-03-06T14:13:22.480 INFO:teuthology.orchestra.run.smithi003.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-03-06T14:13:22.505 INFO:teuthology.orchestra.run.smithi003.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 332 kB/s | 18 kB 00:00 2023-03-06T14:13:22.556 INFO:teuthology.orchestra.run.smithi003.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 973 kB/s | 49 kB 00:00 2023-03-06T14:13:22.614 INFO:teuthology.orchestra.run.smithi003.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-03-06T14:13:22.648 INFO:teuthology.orchestra.run.smithi003.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 7.0 MB/s | 1.2 MB 00:00 2023-03-06T14:13:22.673 INFO:teuthology.orchestra.run.smithi003.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2023-03-06T14:13:22.757 INFO:teuthology.orchestra.run.smithi003.stdout:(55/131): ceph-mgr-diskprediction-local-18.0.0- 5.5 MB/s | 7.4 MB 00:01 2023-03-06T14:13:22.782 INFO:teuthology.orchestra.run.smithi003.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2023-03-06T14:13:22.807 INFO:teuthology.orchestra.run.smithi003.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-03-06T14:13:22.841 INFO:teuthology.orchestra.run.smithi003.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 3.3 MB/s | 196 kB 00:00 2023-03-06T14:13:22.866 INFO:teuthology.orchestra.run.smithi003.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 1.0 MB/s | 61 kB 00:00 2023-03-06T14:13:22.892 INFO:teuthology.orchestra.run.smithi003.stdout:(60/131): python3-repoze-lru-0.7-6.el8.noarch.r 251 kB/s | 34 kB 00:00 2023-03-06T14:13:22.908 INFO:teuthology.orchestra.run.smithi003.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 279 kB/s | 19 kB 00:00 2023-03-06T14:13:22.926 INFO:teuthology.orchestra.run.smithi003.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 407 kB/s | 24 kB 00:00 2023-03-06T14:13:22.942 INFO:teuthology.orchestra.run.smithi003.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 582 kB/s | 29 kB 00:00 2023-03-06T14:13:22.959 INFO:teuthology.orchestra.run.smithi003.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 545 kB/s | 27 kB 00:00 2023-03-06T14:13:22.984 INFO:teuthology.orchestra.run.smithi003.stdout:(65/131): python3-waitress-1.2.1-2.el8.1.noarch 4.0 MB/s | 241 kB 00:00 2023-03-06T14:13:23.001 INFO:teuthology.orchestra.run.smithi003.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.4 MB/s | 61 kB 00:00 2023-03-06T14:13:23.027 INFO:teuthology.orchestra.run.smithi003.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 2.0 MB/s | 85 kB 00:00 2023-03-06T14:13:23.042 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2023-03-06T14:13:23.044 INFO:teuthology.orchestra.run.smithi003.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 547 kB/s | 23 kB 00:00 2023-03-06T14:13:23.046 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2023-03-06T14:13:23.069 INFO:teuthology.orchestra.run.smithi003.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-03-06T14:13:23.094 INFO:teuthology.orchestra.run.smithi003.stdout:(70/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.6 MB/s | 251 kB 00:00 2023-03-06T14:13:23.145 INFO:teuthology.orchestra.run.smithi003.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 624 kB/s | 47 kB 00:00 2023-03-06T14:13:23.170 INFO:teuthology.orchestra.run.smithi003.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.6 MB/s | 200 kB 00:00 2023-03-06T14:13:23.217 INFO:teuthology.orchestra.run.smithi003.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 600 kB/s | 43 kB 00:00 2023-03-06T14:13:23.254 INFO:teuthology.orchestra.run.smithi003.stdout:(74/131): thrift-0.13.0-2.el8.x86_64.rpm 7.6 MB/s | 1.7 MB 00:00 2023-03-06T14:13:23.279 INFO:teuthology.orchestra.run.smithi003.stdout:(75/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-03-06T14:13:23.313 INFO:teuthology.orchestra.run.smithi003.stdout:(76/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 499 kB/s | 48 kB 00:00 2023-03-06T14:13:23.338 INFO:teuthology.orchestra.run.smithi003.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 853 kB/s | 43 kB 00:00 2023-03-06T14:13:23.363 INFO:teuthology.orchestra.run.smithi003.stdout:(78/131): libsepol-devel-2.9-3.el8.x86_64.rpm 800 kB/s | 87 kB 00:00 2023-03-06T14:13:23.389 INFO:teuthology.orchestra.run.smithi003.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-03-06T14:13:23.414 INFO:teuthology.orchestra.run.smithi003.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-03-06T14:13:23.439 INFO:teuthology.orchestra.run.smithi003.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 373 kB/s | 19 kB 00:00 2023-03-06T14:13:23.464 INFO:teuthology.orchestra.run.smithi003.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-03-06T14:13:23.506 INFO:teuthology.orchestra.run.smithi003.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.8 MB/s | 560 kB 00:00 2023-03-06T14:13:23.531 INFO:teuthology.orchestra.run.smithi003.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 267 kB/s | 18 kB 00:00 2023-03-06T14:13:23.565 INFO:teuthology.orchestra.run.smithi003.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 4.3 MB/s | 559 kB 00:00 2023-03-06T14:13:23.591 INFO:teuthology.orchestra.run.smithi003.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-03-06T14:13:23.616 INFO:teuthology.orchestra.run.smithi003.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2023-03-06T14:13:23.641 INFO:teuthology.orchestra.run.smithi003.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-03-06T14:13:23.666 INFO:teuthology.orchestra.run.smithi003.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-03-06T14:13:23.691 INFO:teuthology.orchestra.run.smithi003.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-03-06T14:13:23.717 INFO:teuthology.orchestra.run.smithi003.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-03-06T14:13:23.742 INFO:teuthology.orchestra.run.smithi003.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-03-06T14:13:23.767 INFO:teuthology.orchestra.run.smithi003.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 768 kB/s | 39 kB 00:00 2023-03-06T14:13:23.809 INFO:teuthology.orchestra.run.smithi003.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 9.4 MB/s | 644 kB 00:00 2023-03-06T14:13:23.834 INFO:teuthology.orchestra.run.smithi003.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.5 MB/s | 171 kB 00:00 2023-03-06T14:13:23.860 INFO:teuthology.orchestra.run.smithi003.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-03-06T14:13:23.902 INFO:teuthology.orchestra.run.smithi003.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-03-06T14:13:23.952 INFO:teuthology.orchestra.run.smithi003.stdout:(98/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.0 MB/s | 2.3 MB 00:00 2023-03-06T14:13:23.994 INFO:teuthology.orchestra.run.smithi003.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 588 kB/s | 54 kB 00:00 2023-03-06T14:13:24.120 INFO:teuthology.orchestra.run.smithi003.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.5 MB/s | 259 kB 00:00 2023-03-06T14:13:24.228 INFO:teuthology.orchestra.run.smithi003.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 1.4 MB/s | 323 kB 00:00 2023-03-06T14:13:24.254 INFO:teuthology.orchestra.run.smithi003.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 291 kB/s | 39 kB 00:00 2023-03-06T14:13:24.295 INFO:teuthology.orchestra.run.smithi003.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-03-06T14:13:24.329 INFO:teuthology.orchestra.run.smithi003.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.0 MB/s | 538 kB 00:00 2023-03-06T14:13:24.354 INFO:teuthology.orchestra.run.smithi003.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-03-06T14:13:24.379 INFO:teuthology.orchestra.run.smithi003.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-03-06T14:13:24.430 INFO:teuthology.orchestra.run.smithi003.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 9.3 MB/s | 713 kB 00:00 2023-03-06T14:13:24.455 INFO:teuthology.orchestra.run.smithi003.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 1.0 MB/s | 27 kB 00:00 2023-03-06T14:13:24.497 INFO:teuthology.orchestra.run.smithi003.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-03-06T14:13:24.522 INFO:teuthology.orchestra.run.smithi003.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.7 MB/s | 44 kB 00:00 2023-03-06T14:13:24.623 INFO:teuthology.orchestra.run.smithi003.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-03-06T14:13:24.673 INFO:teuthology.orchestra.run.smithi003.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-03-06T14:13:24.715 INFO:teuthology.orchestra.run.smithi003.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-03-06T14:13:24.782 INFO:teuthology.orchestra.run.smithi003.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2023-03-06T14:13:24.807 INFO:teuthology.orchestra.run.smithi003.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 696 kB/s | 64 kB 00:00 2023-03-06T14:13:24.832 INFO:teuthology.orchestra.run.smithi003.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-03-06T14:13:24.857 INFO:teuthology.orchestra.run.smithi003.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 399 kB/s | 20 kB 00:00 2023-03-06T14:13:24.882 INFO:teuthology.orchestra.run.smithi003.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-03-06T14:13:24.916 INFO:teuthology.orchestra.run.smithi003.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-03-06T14:13:24.959 INFO:teuthology.orchestra.run.smithi003.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-03-06T14:13:25.100 INFO:teuthology.orchestra.run.smithi003.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 11 MB/s | 14 MB 00:01 2023-03-06T14:13:25.142 INFO:teuthology.orchestra.run.smithi003.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-03-06T14:13:25.184 INFO:teuthology.orchestra.run.smithi003.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-03-06T14:13:25.267 INFO:teuthology.orchestra.run.smithi003.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 13 MB/s | 4.9 MB 00:00 2023-03-06T14:13:25.351 INFO:teuthology.orchestra.run.smithi003.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2023-03-06T14:13:25.393 INFO:teuthology.orchestra.run.smithi003.stdout:(126/131): postgresql-contrib-10.21-2.module+el 6.3 MB/s | 808 kB 00:00 2023-03-06T14:13:25.452 INFO:teuthology.orchestra.run.smithi003.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 15 MB/s | 1.5 MB 00:00 2023-03-06T14:13:25.561 INFO:teuthology.orchestra.run.smithi003.stdout:(128/131): postgresql-server-10.21-2.module+el8 13 MB/s | 5.1 MB 00:00 2023-03-06T14:13:25.611 INFO:teuthology.orchestra.run.smithi003.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-03-06T14:13:25.953 INFO:teuthology.orchestra.run.smithi003.stdout:(130/131): librados2-18.0.0-2739.g472aaef4.el8. 6.5 MB/s | 3.7 MB 00:00 2023-03-06T14:13:26.061 INFO:teuthology.orchestra.run.smithi003.stdout:(131/131): librbd1-18.0.0-2739.g472aaef4.el8.x8 5.8 MB/s | 3.6 MB 00:00 2023-03-06T14:13:26.064 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2023-03-06T14:13:26.064 INFO:teuthology.orchestra.run.smithi003.stdout:Total 15 MB/s | 203 MB 00:13 2023-03-06T14:13:26.916 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2023-03-06T14:13:27.048 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2023-03-06T14:13:27.049 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2023-03-06T14:13:27.996 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2023-03-06T14:13:28.143 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-03-06T14:13:28.209 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2023-03-06T14:13:28.213 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2023-03-06T14:13:28.326 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-03-06T14:13:28.495 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-03-06T14:13:28.625 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-03-06T14:13:28.845 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-03-06T14:13:29.235 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-03-06T14:13:29.470 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 5/134 2023-03-06T14:13:29.848 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 5/134 2023-03-06T14:13:30.128 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 6/134 2023-03-06T14:13:30.248 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 6/134 2023-03-06T14:13:30.403 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 7/134 2023-03-06T14:13:30.496 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 7/134 2023-03-06T14:13:30.650 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rados-2:18.0.0-2739.g472aaef4.el8.x86_64 8/134 2023-03-06T14:13:30.862 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-03-06T14:13:31.098 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-03-06T14:13:31.305 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-03-06T14:13:31.694 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-03-06T14:13:31.941 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-03-06T14:13:32.111 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 14/134 2023-03-06T14:13:32.211 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 14/134 2023-03-06T14:13:32.361 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86 15/134 2023-03-06T14:13:32.504 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86 15/134 2023-03-06T14:13:32.689 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-03-06T14:13:32.892 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-03-06T14:13:33.071 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-03-06T14:13:33.202 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-03-06T14:13:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-03-06T14:13:33.368 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2023-03-06T14:13:33.485 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-03-06T14:13:33.531 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-03-06T14:13:33.708 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-03-06T14:13:33.874 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-03-06T14:13:34.058 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-03-06T14:13:34.085 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-03-06T14:13:34.232 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-03-06T14:13:34.277 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-03-06T14:13:34.666 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-03-06T14:13:34.877 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-03-06T14:13:34.900 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 5/134 2023-03-06T14:13:35.060 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-03-06T14:13:35.327 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 5/134 2023-03-06T14:13:35.574 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 6/134 2023-03-06T14:13:35.706 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 6/134 2023-03-06T14:13:35.881 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-03-06T14:13:35.882 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 7/134 2023-03-06T14:13:35.968 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 7/134 2023-03-06T14:13:36.121 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rados-2:18.0.0-2739.g472aaef4.el8.x86_64 8/134 2023-03-06T14:13:36.126 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-03-06T14:13:36.317 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-03-06T14:13:36.324 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-03-06T14:13:36.519 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-03-06T14:13:36.541 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-03-06T14:13:36.683 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-common-2:18.0.0-2739.g472aaef4.el8. 26/134 2023-03-06T14:13:36.728 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-03-06T14:13:36.812 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-argparse-2:18.0.0-2739.g472aaef4.el 27/134 2023-03-06T14:13:37.056 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cephfs-2:18.0.0-2739.g472aaef4.el8.x86_6 28/134 2023-03-06T14:13:37.116 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-03-06T14:13:37.235 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-03-06T14:13:37.345 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-03-06T14:13:37.632 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 14/134 2023-03-06T14:13:37.726 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 14/134 2023-03-06T14:13:37.915 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86 15/134 2023-03-06T14:13:38.055 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86 15/134 2023-03-06T14:13:38.244 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-03-06T14:13:38.423 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-03-06T14:13:38.623 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-03-06T14:13:38.765 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-03-06T14:13:38.893 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-03-06T14:13:39.005 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-03-06T14:13:39.007 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-03-06T14:13:39.660 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-03-06T14:13:39.840 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-03-06T14:13:40.063 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-03-06T14:13:40.366 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-03-06T14:13:40.459 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-03-06T14:13:40.611 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-03-06T14:13:40.838 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-03-06T14:13:40.840 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-03-06T14:13:41.104 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-03-06T14:13:41.294 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-03-06T14:13:41.465 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rbd-2:18.0.0-2739.g472aaef4.el8.x86_64 36/134 2023-03-06T14:13:41.613 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-03-06T14:13:41.623 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librados-devel-2:18.0.0-2739.g472aaef4.el8.x86_6 37/134 2023-03-06T14:13:41.783 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-03-06T14:13:41.887 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-03-06T14:13:41.943 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-03-06T14:13:42.067 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-03-06T14:13:42.117 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-03-06T14:13:42.188 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-03-06T14:13:42.269 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-03-06T14:13:42.388 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-03-06T14:13:42.446 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ceph-common-2:18.0.0-2739.g472aaef4.el8. 26/134 2023-03-06T14:13:42.568 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ceph-argparse-2:18.0.0-2739.g472aaef4.el 27/134 2023-03-06T14:13:42.579 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-03-06T14:13:42.725 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-03-06T14:13:42.791 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-03-06T14:13:42.925 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cephfs-2:18.0.0-2739.g472aaef4.el8.x86_6 28/134 2023-03-06T14:13:43.049 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-03-06T14:13:43.098 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-03-06T14:13:43.187 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-03-06T14:13:43.360 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-03-06T14:13:43.540 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-03-06T14:13:43.719 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-03-06T14:13:43.870 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-03-06T14:13:44.057 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-03-06T14:13:44.246 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-03-06T14:13:44.575 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-03-06T14:13:44.842 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-03-06T14:13:44.991 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-03-06T14:13:45.094 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-03-06T14:13:45.362 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-03-06T14:13:45.579 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-03-06T14:13:45.883 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-03-06T14:13:46.057 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-03-06T14:13:46.284 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-03-06T14:13:46.617 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-03-06T14:13:46.629 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-03-06T14:13:46.839 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-03-06T14:13:46.854 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-03-06T14:13:46.998 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-03-06T14:13:47.042 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-03-06T14:13:47.178 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-03-06T14:13:47.262 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-03-06T14:13:47.420 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-03-06T14:13:47.479 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-03-06T14:13:47.579 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rbd-2:18.0.0-2739.g472aaef4.el8.x86_64 36/134 2023-03-06T14:13:47.712 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librados-devel-2:18.0.0-2739.g472aaef4.el8.x86_6 37/134 2023-03-06T14:13:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-03-06T14:13:47.888 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-03-06T14:13:48.003 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-03-06T14:13:48.149 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-03-06T14:13:48.217 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-03-06T14:13:48.289 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-03-06T14:13:48.367 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-03-06T14:13:48.373 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-03-06T14:13:48.552 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-03-06T14:13:48.590 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-03-06T14:13:48.821 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-03-06T14:13:48.840 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-03-06T14:13:48.972 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-03-06T14:13:49.022 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2023-03-06T14:13:49.036 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-03-06T14:13:49.186 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-03-06T14:13:49.248 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-03-06T14:13:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-03-06T14:13:49.427 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-03-06T14:13:49.523 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-03-06T14:13:49.590 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-03-06T14:13:49.710 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-03-06T14:13:49.751 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-03-06T14:13:49.900 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-03-06T14:13:49.908 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-03-06T14:13:50.027 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-03-06T14:13:50.060 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-03-06T14:13:50.196 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-03-06T14:13:50.233 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-03-06T14:13:50.424 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-03-06T14:13:50.427 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-03-06T14:13:50.627 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-03-06T14:13:50.795 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-03-06T14:13:50.920 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-03-06T14:13:51.052 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-03-06T14:13:51.175 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-03-06T14:13:51.331 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-03-06T14:13:51.367 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-03-06T14:13:51.506 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-03-06T14:13:51.599 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-03-06T14:13:51.729 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-03-06T14:13:51.938 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-03-06T14:13:52.252 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-03-06T14:13:52.455 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-03-06T14:13:52.702 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-03-06T14:13:52.820 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-03-06T14:13:52.897 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-03-06T14:13:53.062 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-03-06T14:13:53.077 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-03-06T14:13:53.227 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-03-06T14:13:53.297 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-03-06T14:13:53.577 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-03-06T14:13:53.598 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-03-06T14:13:53.879 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-03-06T14:13:53.879 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-03-06T14:13:54.059 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-03-06T14:13:54.147 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-03-06T14:13:54.381 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-03-06T14:13:54.521 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-03-06T14:13:54.709 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-03-06T14:13:54.829 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-03-06T14:13:54.992 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-03-06T14:13:55.005 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 92/134 2023-03-06T14:13:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 92/134 2023-03-06T14:13:55.186 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2023-03-06T14:13:55.281 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rgw-2:18.0.0-2739.g472aaef4.el8.x86_64 93/134 2023-03-06T14:13:55.317 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-03-06T14:13:55.457 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-03-06T14:13:55.658 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-03-06T14:13:55.834 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-03-06T14:13:55.992 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-03-06T14:13:56.141 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-03-06T14:13:56.261 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-03-06T14:13:56.498 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-03-06T14:13:56.692 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-03-06T14:13:56.903 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-03-06T14:13:57.159 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-03-06T14:13:57.379 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-03-06T14:13:57.530 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-03-06T14:13:57.718 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-03-06T14:13:58.777 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 94/134 2023-03-06T14:13:58.895 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-03-06T14:13:59.005 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 94/134 2023-03-06T14:13:59.135 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-03-06T14:13:59.338 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-03-06T14:13:59.590 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 94/134 2023-03-06T14:13:59.725 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-03-06T14:13:59.841 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 95/134 2023-03-06T14:13:59.909 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 95/134 2023-03-06T14:13:59.978 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-03-06T14:14:00.038 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 96/134 2023-03-06T14:14:00.166 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-03-06T14:14:00.968 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-03-06T14:14:01.145 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 92/134 2023-03-06T14:14:01.224 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 92/134 2023-03-06T14:14:01.379 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rgw-2:18.0.0-2739.g472aaef4.el8.x86_64 93/134 2023-03-06T14:14:05.100 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 94/134 2023-03-06T14:14:05.295 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 94/134 2023-03-06T14:14:05.950 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 94/134 2023-03-06T14:14:06.219 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 95/134 2023-03-06T14:14:06.301 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 95/134 2023-03-06T14:14:06.461 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 96/134 2023-03-06T14:14:18.733 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 96/134 2023-03-06T14:14:18.733 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /sys 2023-03-06T14:14:18.733 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /proc 2023-03-06T14:14:18.733 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /dev 2023-03-06T14:14:18.733 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /run 2023-03-06T14:14:18.734 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /mnt 2023-03-06T14:14:18.734 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /var/tmp 2023-03-06T14:14:18.734 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /home 2023-03-06T14:14:18.734 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /tmp 2023-03-06T14:14:18.734 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /dev 2023-03-06T14:14:18.734 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:19.051 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 97/134 2023-03-06T14:14:20.618 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 97/134 2023-03-06T14:14:20.786 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 98/134 2023-03-06T14:14:21.003 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 98/134 2023-03-06T14:14:21.150 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 99/134 2023-03-06T14:14:21.598 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 99/134 2023-03-06T14:14:21.775 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 100/134 2023-03-06T14:14:21.792 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 100/134 2023-03-06T14:14:23.430 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 101/134 2023-03-06T14:14:23.613 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 101/134 2023-03-06T14:14:23.722 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-2739.g472aaef4.e 102/134 2023-03-06T14:14:23.881 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-2739.g472aaef4. 103/134 2023-03-06T14:14:24.066 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noa 104/134 2023-03-06T14:14:24.282 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noa 104/134 2023-03-06T14:14:24.510 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.n 105/134 2023-03-06T14:14:25.475 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.n 105/134 2023-03-06T14:14:25.632 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-2739.g472 106/134 2023-03-06T14:14:25.722 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-2739.g472 106/134 2023-03-06T14:14:25.794 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 96/134 2023-03-06T14:14:25.795 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /sys 2023-03-06T14:14:25.795 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /proc 2023-03-06T14:14:25.795 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /dev 2023-03-06T14:14:25.795 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /run 2023-03-06T14:14:25.795 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /mnt 2023-03-06T14:14:25.795 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /var/tmp 2023-03-06T14:14:25.795 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /home 2023-03-06T14:14:25.796 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /tmp 2023-03-06T14:14:25.796 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /dev 2023-03-06T14:14:25.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:26.125 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 97/134 2023-03-06T14:14:26.147 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-2739.g472aaef4.el 107/134 2023-03-06T14:14:26.335 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 108/134 2023-03-06T14:14:26.371 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 108/134 2023-03-06T14:14:26.541 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 109/134 2023-03-06T14:14:26.552 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 109/134 2023-03-06T14:14:27.804 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-2:18.0.0-2739.g472aaef4.el8.x86_64 110/134 2023-03-06T14:14:27.808 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 97/134 2023-03-06T14:14:28.016 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 98/134 2023-03-06T14:14:28.035 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 111/134 2023-03-06T14:14:28.070 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 111/134 2023-03-06T14:14:28.215 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-2739.g472aa 112/134 2023-03-06T14:14:28.246 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 98/134 2023-03-06T14:14:28.257 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-2739.g472aa 112/134 2023-03-06T14:14:28.399 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 99/134 2023-03-06T14:14:28.415 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 113/134 2023-03-06T14:14:28.761 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 113/134 2023-03-06T14:14:28.877 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 99/134 2023-03-06T14:14:28.907 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 114/134 2023-03-06T14:14:29.041 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 100/134 2023-03-06T14:14:29.058 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 100/134 2023-03-06T14:14:30.775 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 101/134 2023-03-06T14:14:30.960 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 101/134 2023-03-06T14:14:31.122 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-2739.g472aaef4.e 102/134 2023-03-06T14:14:31.306 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-2739.g472aaef4. 103/134 2023-03-06T14:14:31.515 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noa 104/134 2023-03-06T14:14:31.739 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noa 104/134 2023-03-06T14:14:31.990 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.n 105/134 2023-03-06T14:14:33.015 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.n 105/134 2023-03-06T14:14:33.156 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-2739.g472 106/134 2023-03-06T14:14:33.251 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-2739.g472 106/134 2023-03-06T14:14:33.327 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 114/134 2023-03-06T14:14:33.626 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-2739.g472aaef4.el 107/134 2023-03-06T14:14:33.781 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 108/134 2023-03-06T14:14:33.818 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 108/134 2023-03-06T14:14:33.981 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 109/134 2023-03-06T14:14:33.993 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 109/134 2023-03-06T14:14:34.189 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-test-2:18.0.0-2739.g472aaef4.el8.x86_64 115/134 2023-03-06T14:14:34.503 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-03-06T14:14:34.671 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 117/134 2023-03-06T14:14:34.920 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-03-06T14:14:35.080 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-03-06T14:14:35.269 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-03-06T14:14:35.313 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-2:18.0.0-2739.g472aaef4.el8.x86_64 110/134 2023-03-06T14:14:35.501 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-03-06T14:14:35.519 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 111/134 2023-03-06T14:14:35.554 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 111/134 2023-03-06T14:14:35.659 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs-devel-2:18.0.0-2739.g472aaef4.el8.x86_ 121/134 2023-03-06T14:14:35.748 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-2739.g472aa 112/134 2023-03-06T14:14:35.781 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-03-06T14:14:35.792 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-2739.g472aa 112/134 2023-03-06T14:14:35.932 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 113/134 2023-03-06T14:14:36.307 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 113/134 2023-03-06T14:14:36.498 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 114/134 2023-03-06T14:14:37.828 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-06T14:14:38.080 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-06T14:14:38.098 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-06T14:14:38.305 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-top-2:18.0.0-2739.g472aaef4.el8.noarch 124/134 2023-03-06T14:14:38.562 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 125/134 2023-03-06T14:14:38.846 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-nbd-2:18.0.0-2739.g472aaef4.el8.x86_64 126/134 2023-03-06T14:14:39.159 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-03-06T14:14:39.337 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-03-06T14:14:39.424 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-03-06T14:14:39.629 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-03-06T14:14:39.642 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-03-06T14:14:39.787 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-03-06T14:14:39.796 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-03-06T14:14:39.948 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-03-06T14:14:39.948 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-06T14:14:40.140 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-06T14:14:40.141 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-06T14:14:40.398 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-06T14:14:40.586 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-06T14:14:40.874 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-03-06T14:14:40.875 INFO:teuthology.orchestra.run.smithi136.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-03-06T14:14:40.875 INFO:teuthology.orchestra.run.smithi136.stdout:All rules containing unresolvable specifiers will be skipped. 2023-03-06T14:14:40.875 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:41.098 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-2:18.0.0-2739.g472aaef4.el8.x86_64 1/134 2023-03-06T14:14:41.098 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 2/134 2023-03-06T14:14:41.098 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 3/134 2023-03-06T14:14:41.098 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 4/134 2023-03-06T14:14:41.099 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-2739.g472aa 5/134 2023-03-06T14:14:41.099 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 6/134 2023-03-06T14:14:41.099 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 7/134 2023-03-06T14:14:41.099 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 8/134 2023-03-06T14:14:41.099 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 9/134 2023-03-06T14:14:41.099 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 10/134 2023-03-06T14:14:41.099 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 11/134 2023-03-06T14:14:41.100 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-test-2:18.0.0-2739.g472aaef4.el8.x86_64 12/134 2023-03-06T14:14:41.100 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 13/134 2023-03-06T14:14:41.100 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs-devel-2:18.0.0-2739.g472aaef4.el8.x86_ 14/134 2023-03-06T14:14:41.100 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 15/134 2023-03-06T14:14:41.100 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 16/134 2023-03-06T14:14:41.101 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados-devel-2:18.0.0-2739.g472aaef4.el8.x86_6 17/134 2023-03-06T14:14:41.101 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86 18/134 2023-03-06T14:14:41.101 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 19/134 2023-03-06T14:14:41.101 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-argparse-2:18.0.0-2739.g472aaef4.el 20/134 2023-03-06T14:14:41.102 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-common-2:18.0.0-2739.g472aaef4.el8. 21/134 2023-03-06T14:14:41.102 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cephfs-2:18.0.0-2739.g472aaef4.el8.x86_6 22/134 2023-03-06T14:14:41.102 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rados-2:18.0.0-2739.g472aaef4.el8.x86_64 23/134 2023-03-06T14:14:41.102 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rbd-2:18.0.0-2739.g472aaef4.el8.x86_64 24/134 2023-03-06T14:14:41.102 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rgw-2:18.0.0-2739.g472aaef4.el8.x86_64 25/134 2023-03-06T14:14:41.102 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 26/134 2023-03-06T14:14:41.103 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 27/134 2023-03-06T14:14:41.103 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-nbd-2:18.0.0-2739.g472aaef4.el8.x86_64 28/134 2023-03-06T14:14:41.103 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-2739.g472aaef4. 29/134 2023-03-06T14:14:41.103 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noa 30/134 2023-03-06T14:14:41.103 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.n 31/134 2023-03-06T14:14:41.103 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-2739.g472 32/134 2023-03-06T14:14:41.103 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-2739.g472aaef4.el 33/134 2023-03-06T14:14:41.103 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 34/134 2023-03-06T14:14:41.104 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-2739.g472aaef4.e 35/134 2023-03-06T14:14:41.104 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 36/134 2023-03-06T14:14:41.104 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 37/134 2023-03-06T14:14:41.104 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-top-2:18.0.0-2739.g472aaef4.el8.noarch 38/134 2023-03-06T14:14:41.104 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-03-06T14:14:41.104 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-03-06T14:14:41.104 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-03-06T14:14:41.105 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-03-06T14:14:41.105 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-03-06T14:14:41.105 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-03-06T14:14:41.105 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-03-06T14:14:41.105 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-03-06T14:14:41.105 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-03-06T14:14:41.105 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-03-06T14:14:41.106 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-03-06T14:14:41.106 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-03-06T14:14:41.106 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-03-06T14:14:41.106 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-03-06T14:14:41.106 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-03-06T14:14:41.106 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-03-06T14:14:41.106 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-03-06T14:14:41.106 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-03-06T14:14:41.107 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-03-06T14:14:41.107 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-03-06T14:14:41.107 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-03-06T14:14:41.107 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-03-06T14:14:41.107 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-03-06T14:14:41.107 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-03-06T14:14:41.107 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-03-06T14:14:41.108 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-03-06T14:14:41.108 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/134 2023-03-06T14:14:41.108 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-03-06T14:14:41.108 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-03-06T14:14:41.108 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-03-06T14:14:41.109 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-03-06T14:14:41.109 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-03-06T14:14:41.109 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-03-06T14:14:41.109 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-03-06T14:14:41.109 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-03-06T14:14:41.109 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-03-06T14:14:41.109 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-03-06T14:14:41.109 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-03-06T14:14:41.110 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-03-06T14:14:41.110 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-03-06T14:14:41.110 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-03-06T14:14:41.110 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-03-06T14:14:41.110 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-03-06T14:14:41.110 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-03-06T14:14:41.110 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-03-06T14:14:41.111 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-03-06T14:14:41.111 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-03-06T14:14:41.111 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-03-06T14:14:41.111 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-03-06T14:14:41.111 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-03-06T14:14:41.111 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-03-06T14:14:41.111 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-03-06T14:14:41.111 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-03-06T14:14:41.112 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-03-06T14:14:41.112 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-03-06T14:14:41.112 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-03-06T14:14:41.112 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-03-06T14:14:41.112 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-03-06T14:14:41.112 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-03-06T14:14:41.113 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-03-06T14:14:41.113 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-03-06T14:14:41.113 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-03-06T14:14:41.113 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-03-06T14:14:41.113 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-03-06T14:14:41.113 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-03-06T14:14:41.114 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-03-06T14:14:41.114 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-03-06T14:14:41.114 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-03-06T14:14:41.114 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-03-06T14:14:41.114 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-03-06T14:14:41.114 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-03-06T14:14:41.114 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-03-06T14:14:41.115 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-03-06T14:14:41.115 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-03-06T14:14:41.115 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-03-06T14:14:41.115 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-03-06T14:14:41.115 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-03-06T14:14:41.115 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-03-06T14:14:41.115 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-03-06T14:14:41.115 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-03-06T14:14:41.116 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-03-06T14:14:41.116 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-03-06T14:14:41.116 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-03-06T14:14:41.116 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-03-06T14:14:41.116 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-03-06T14:14:41.116 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-03-06T14:14:41.116 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-03-06T14:14:41.117 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-03-06T14:14:41.117 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-03-06T14:14:41.117 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-03-06T14:14:41.117 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 129/134 2023-03-06T14:14:41.117 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-03-06T14:14:41.117 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 131/134 2023-03-06T14:14:41.117 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-06T14:14:41.118 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-03-06T14:14:41.236 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 114/134 2023-03-06T14:14:42.147 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-test-2:18.0.0-2739.g472aaef4.el8.x86_64 115/134 2023-03-06T14:14:42.441 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-03-06T14:14:42.609 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 117/134 2023-03-06T14:14:42.889 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-03-06T14:14:43.030 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-03-06T14:14:43.236 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-03-06T14:14:43.485 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-03-06T14:14:43.634 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephfs-devel-2:18.0.0-2739.g472aaef4.el8.x86_ 121/134 2023-03-06T14:14:43.748 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-03-06T14:14:43.763 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-06T14:14:43.763 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:44 ago on Mon 06 Mar 2023 02:12:59 PM UTC. 2023-03-06T14:14:46.002 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-06T14:14:46.221 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-06T14:14:46.239 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-06T14:14:46.380 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : cephfs-top-2:18.0.0-2739.g472aaef4.el8.noarch 124/134 2023-03-06T14:14:46.417 INFO:teuthology.orchestra.run.smithi136.stdout:Installed products updated. 2023-03-06T14:14:46.639 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 125/134 2023-03-06T14:14:46.649 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:46.649 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2023-03-06T14:14:46.650 INFO:teuthology.orchestra.run.smithi136.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-03-06T14:14:46.650 INFO:teuthology.orchestra.run.smithi136.stdout: librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.650 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.650 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2023-03-06T14:14:46.650 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-03-06T14:14:46.650 INFO:teuthology.orchestra.run.smithi136.stdout: automake-1.16.1-7.el8.noarch 2023-03-06T14:14:46.651 INFO:teuthology.orchestra.run.smithi136.stdout: bison-3.0.4-10.el8.x86_64 2023-03-06T14:14:46.651 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.651 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.651 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.651 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.651 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:46.651 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.651 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.652 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.652 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:46.652 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:46.652 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:46.652 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:46.652 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:46.652 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.653 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.653 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:46.653 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.653 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.653 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.653 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:46.653 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:46.654 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.654 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:46.654 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-03-06T14:14:46.654 INFO:teuthology.orchestra.run.smithi136.stdout: flex-2.6.1-9.el8.x86_64 2023-03-06T14:14:46.654 INFO:teuthology.orchestra.run.smithi136.stdout: fuse-2.9.7-15.el8.x86_64 2023-03-06T14:14:46.654 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-03-06T14:14:46.654 INFO:teuthology.orchestra.run.smithi136.stdout: jq-1.6-3.el8.x86_64 2023-03-06T14:14:46.655 INFO:teuthology.orchestra.run.smithi136.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-03-06T14:14:46.655 INFO:teuthology.orchestra.run.smithi136.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-03-06T14:14:46.655 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-03-06T14:14:46.655 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.655 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.655 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.655 INFO:teuthology.orchestra.run.smithi136.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-03-06T14:14:46.655 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-03-06T14:14:46.656 INFO:teuthology.orchestra.run.smithi136.stdout: liboath-2.6.2-3.el8.x86_64 2023-03-06T14:14:46.656 INFO:teuthology.orchestra.run.smithi136.stdout: libpq-13.5-1.el8.x86_64 2023-03-06T14:14:46.656 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-03-06T14:14:46.656 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-03-06T14:14:46.656 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.656 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.656 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-03-06T14:14:46.656 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.657 INFO:teuthology.orchestra.run.smithi136.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-03-06T14:14:46.657 INFO:teuthology.orchestra.run.smithi136.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-03-06T14:14:46.657 INFO:teuthology.orchestra.run.smithi136.stdout: libtool-2.4.6-25.el8.x86_64 2023-03-06T14:14:46.657 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind-1.3.1-3.el8.x86_64 2023-03-06T14:14:46.657 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-03-06T14:14:46.657 INFO:teuthology.orchestra.run.smithi136.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-03-06T14:14:46.657 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-03-06T14:14:46.658 INFO:teuthology.orchestra.run.smithi136.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-03-06T14:14:46.658 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-0.3.15-3.el8.x86_64 2023-03-06T14:14:46.658 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-03-06T14:14:46.658 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-03-06T14:14:46.658 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-03-06T14:14:46.658 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-03-06T14:14:46.658 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-03-06T14:14:46.658 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-06T14:14:46.659 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-06T14:14:46.659 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-06T14:14:46.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-03-06T14:14:46.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel-2.5.1-7.el8.noarch 2023-03-06T14:14:46.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-03-06T14:14:46.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-03-06T14:14:46.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-03-06T14:14:46.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-03-06T14:14:46.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-03-06T14:14:46.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-03-06T14:14:46.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-03-06T14:14:46.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-03-06T14:14:46.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-03-06T14:14:46.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-6.2-6.el8.noarch 2023-03-06T14:14:46.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-03-06T14:14:46.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-03-06T14:14:46.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-03-06T14:14:46.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-03-06T14:14:46.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-03-06T14:14:46.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-03-06T14:14:46.662 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-03-06T14:14:46.662 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako-1.0.6-13.el8.noarch 2023-03-06T14:14:46.662 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-03-06T14:14:46.662 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-03-06T14:14:46.662 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-03-06T14:14:46.662 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-03-06T14:14:46.662 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-03-06T14:14:46.662 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-03-06T14:14:46.663 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-03-06T14:14:46.663 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend-2.6-1.el8.noarch 2023-03-06T14:14:46.663 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-03-06T14:14:46.663 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-03-06T14:14:46.663 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-03-06T14:14:46.663 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-03-06T14:14:46.663 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser-2.14-14.el8.noarch 2023-03-06T14:14:46.664 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz-2017.2-9.el8.noarch 2023-03-06T14:14:46.664 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.664 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.664 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-03-06T14:14:46.664 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-03-06T14:14:46.664 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.664 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes-2.4.1-12.el8.noarch 2023-03-06T14:14:46.664 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa-4.8-1.el8.noarch 2023-03-06T14:14:46.665 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-03-06T14:14:46.665 INFO:teuthology.orchestra.run.smithi136.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-03-06T14:14:46.665 INFO:teuthology.orchestra.run.smithi136.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-03-06T14:14:46.665 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-03-06T14:14:46.665 INFO:teuthology.orchestra.run.smithi136.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-03-06T14:14:46.665 INFO:teuthology.orchestra.run.smithi136.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-03-06T14:14:46.665 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-03-06T14:14:46.666 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-03-06T14:14:46.666 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-03-06T14:14:46.666 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-03-06T14:14:46.666 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-03-06T14:14:46.666 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.666 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.666 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:46.667 INFO:teuthology.orchestra.run.smithi136.stdout: socat-1.7.4.1-1.el8.x86_64 2023-03-06T14:14:46.667 INFO:teuthology.orchestra.run.smithi136.stdout: thrift-0.13.0-2.el8.x86_64 2023-03-06T14:14:46.667 INFO:teuthology.orchestra.run.smithi136.stdout: uuid-1.6.2-43.el8.x86_64 2023-03-06T14:14:46.667 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-03-06T14:14:46.667 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-03-06T14:14:46.668 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-03-06T14:14:46.668 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:46.668 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2023-03-06T14:14:46.848 DEBUG:teuthology.parallel:result is None 2023-03-06T14:14:46.937 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-nbd-2:18.0.0-2739.g472aaef4.el8.x86_64 126/134 2023-03-06T14:14:47.265 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-03-06T14:14:47.446 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-03-06T14:14:47.535 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-03-06T14:14:47.729 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-03-06T14:14:47.742 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-03-06T14:14:47.880 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-03-06T14:14:47.889 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-03-06T14:14:48.023 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-03-06T14:14:48.024 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-06T14:14:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-06T14:14:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-06T14:14:48.437 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-06T14:14:48.596 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-06T14:14:48.897 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-03-06T14:14:48.898 INFO:teuthology.orchestra.run.smithi003.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-03-06T14:14:48.898 INFO:teuthology.orchestra.run.smithi003.stdout:All rules containing unresolvable specifiers will be skipped. 2023-03-06T14:14:48.898 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:49.125 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-2:18.0.0-2739.g472aaef4.el8.x86_64 1/134 2023-03-06T14:14:49.125 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 2/134 2023-03-06T14:14:49.125 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 3/134 2023-03-06T14:14:49.125 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 4/134 2023-03-06T14:14:49.125 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-2739.g472aa 5/134 2023-03-06T14:14:49.126 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 6/134 2023-03-06T14:14:49.126 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 7/134 2023-03-06T14:14:49.126 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 8/134 2023-03-06T14:14:49.126 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 9/134 2023-03-06T14:14:49.126 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 10/134 2023-03-06T14:14:49.126 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 11/134 2023-03-06T14:14:49.126 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-test-2:18.0.0-2739.g472aaef4.el8.x86_64 12/134 2023-03-06T14:14:49.126 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 13/134 2023-03-06T14:14:49.127 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephfs-devel-2:18.0.0-2739.g472aaef4.el8.x86_ 14/134 2023-03-06T14:14:49.127 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 15/134 2023-03-06T14:14:49.127 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 16/134 2023-03-06T14:14:49.127 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados-devel-2:18.0.0-2739.g472aaef4.el8.x86_6 17/134 2023-03-06T14:14:49.127 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86 18/134 2023-03-06T14:14:49.127 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 19/134 2023-03-06T14:14:49.127 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ceph-argparse-2:18.0.0-2739.g472aaef4.el 20/134 2023-03-06T14:14:49.128 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ceph-common-2:18.0.0-2739.g472aaef4.el8. 21/134 2023-03-06T14:14:49.128 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cephfs-2:18.0.0-2739.g472aaef4.el8.x86_6 22/134 2023-03-06T14:14:49.128 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rados-2:18.0.0-2739.g472aaef4.el8.x86_64 23/134 2023-03-06T14:14:49.128 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rbd-2:18.0.0-2739.g472aaef4.el8.x86_64 24/134 2023-03-06T14:14:49.128 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rgw-2:18.0.0-2739.g472aaef4.el8.x86_64 25/134 2023-03-06T14:14:49.128 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 26/134 2023-03-06T14:14:49.128 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 27/134 2023-03-06T14:14:49.128 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-nbd-2:18.0.0-2739.g472aaef4.el8.x86_64 28/134 2023-03-06T14:14:49.129 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-2739.g472aaef4. 29/134 2023-03-06T14:14:49.136 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noa 30/134 2023-03-06T14:14:49.136 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.n 31/134 2023-03-06T14:14:49.137 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-2739.g472 32/134 2023-03-06T14:14:49.137 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-2739.g472aaef4.el 33/134 2023-03-06T14:14:49.137 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 34/134 2023-03-06T14:14:49.137 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-2739.g472aaef4.e 35/134 2023-03-06T14:14:49.137 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 36/134 2023-03-06T14:14:49.137 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 37/134 2023-03-06T14:14:49.138 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : cephfs-top-2:18.0.0-2739.g472aaef4.el8.noarch 38/134 2023-03-06T14:14:49.138 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-03-06T14:14:49.138 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-03-06T14:14:49.138 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-03-06T14:14:49.138 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-03-06T14:14:49.138 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-03-06T14:14:49.138 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-03-06T14:14:49.138 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-03-06T14:14:49.139 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-03-06T14:14:49.139 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-03-06T14:14:49.139 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-03-06T14:14:49.139 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-03-06T14:14:49.139 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-03-06T14:14:49.139 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-03-06T14:14:49.139 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-03-06T14:14:49.139 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-03-06T14:14:49.140 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-03-06T14:14:49.140 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-03-06T14:14:49.140 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-03-06T14:14:49.140 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-03-06T14:14:49.140 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-03-06T14:14:49.140 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-03-06T14:14:49.140 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-03-06T14:14:49.141 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-03-06T14:14:49.141 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-03-06T14:14:49.141 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-03-06T14:14:49.141 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-03-06T14:14:49.141 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/134 2023-03-06T14:14:49.141 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-03-06T14:14:49.141 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-03-06T14:14:49.141 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-03-06T14:14:49.142 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-03-06T14:14:49.142 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-03-06T14:14:49.142 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-03-06T14:14:49.142 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-03-06T14:14:49.142 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-03-06T14:14:49.142 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-03-06T14:14:49.142 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-03-06T14:14:49.143 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-03-06T14:14:49.143 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-03-06T14:14:49.143 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-03-06T14:14:49.143 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-03-06T14:14:49.143 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-03-06T14:14:49.143 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-03-06T14:14:49.143 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-03-06T14:14:49.143 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-03-06T14:14:49.144 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-03-06T14:14:49.144 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-03-06T14:14:49.144 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-03-06T14:14:49.144 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-03-06T14:14:49.144 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-03-06T14:14:49.144 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-03-06T14:14:49.144 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-03-06T14:14:49.145 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-03-06T14:14:49.145 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-03-06T14:14:49.145 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-03-06T14:14:49.145 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-03-06T14:14:49.145 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-03-06T14:14:49.145 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-03-06T14:14:49.145 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-03-06T14:14:49.145 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-03-06T14:14:49.146 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-03-06T14:14:49.146 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-03-06T14:14:49.146 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-03-06T14:14:49.146 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-03-06T14:14:49.146 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-03-06T14:14:49.146 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-03-06T14:14:49.146 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-03-06T14:14:49.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-03-06T14:14:49.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-03-06T14:14:49.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-03-06T14:14:49.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-03-06T14:14:49.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-03-06T14:14:49.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-03-06T14:14:49.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-03-06T14:14:49.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-03-06T14:14:49.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-03-06T14:14:49.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-03-06T14:14:49.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-03-06T14:14:49.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-03-06T14:14:49.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-03-06T14:14:49.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-03-06T14:14:49.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-03-06T14:14:49.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-03-06T14:14:49.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-03-06T14:14:49.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-03-06T14:14:49.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-03-06T14:14:49.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-03-06T14:14:49.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-03-06T14:14:49.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-03-06T14:14:49.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-03-06T14:14:49.150 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 129/134 2023-03-06T14:14:49.150 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-03-06T14:14:49.150 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 131/134 2023-03-06T14:14:49.150 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-06T14:14:49.150 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-03-06T14:14:51.889 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-06T14:14:51.889 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:51 ago on Mon 06 Mar 2023 02:13:00 PM UTC. 2023-03-06T14:14:55.392 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2023-03-06T14:14:55.635 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:55.635 INFO:teuthology.orchestra.run.smithi003.stdout:Upgraded: 2023-03-06T14:14:55.635 INFO:teuthology.orchestra.run.smithi003.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-03-06T14:14:55.635 INFO:teuthology.orchestra.run.smithi003.stdout: librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.636 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.636 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2023-03-06T14:14:55.636 INFO:teuthology.orchestra.run.smithi003.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-03-06T14:14:55.636 INFO:teuthology.orchestra.run.smithi003.stdout: automake-1.16.1-7.el8.noarch 2023-03-06T14:14:55.636 INFO:teuthology.orchestra.run.smithi003.stdout: bison-3.0.4-10.el8.x86_64 2023-03-06T14:14:55.636 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.637 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.637 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.637 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.637 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:55.637 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.637 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.637 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.638 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:55.638 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:55.638 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:55.638 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:55.638 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:55.638 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.638 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.639 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-prometheus-alerts-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:55.639 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.639 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.639 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.639 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:55.639 INFO:teuthology.orchestra.run.smithi003.stdout: cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:55.639 INFO:teuthology.orchestra.run.smithi003.stdout: cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.640 INFO:teuthology.orchestra.run.smithi003.stdout: cephfs-top-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T14:14:55.640 INFO:teuthology.orchestra.run.smithi003.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-03-06T14:14:55.640 INFO:teuthology.orchestra.run.smithi003.stdout: flex-2.6.1-9.el8.x86_64 2023-03-06T14:14:55.641 INFO:teuthology.orchestra.run.smithi003.stdout: fuse-2.9.7-15.el8.x86_64 2023-03-06T14:14:55.641 INFO:teuthology.orchestra.run.smithi003.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-03-06T14:14:55.641 INFO:teuthology.orchestra.run.smithi003.stdout: jq-1.6-3.el8.x86_64 2023-03-06T14:14:55.641 INFO:teuthology.orchestra.run.smithi003.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-03-06T14:14:55.642 INFO:teuthology.orchestra.run.smithi003.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-03-06T14:14:55.642 INFO:teuthology.orchestra.run.smithi003.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-03-06T14:14:55.642 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.642 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.643 INFO:teuthology.orchestra.run.smithi003.stdout: libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.643 INFO:teuthology.orchestra.run.smithi003.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-03-06T14:14:55.643 INFO:teuthology.orchestra.run.smithi003.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-03-06T14:14:55.643 INFO:teuthology.orchestra.run.smithi003.stdout: liboath-2.6.2-3.el8.x86_64 2023-03-06T14:14:55.644 INFO:teuthology.orchestra.run.smithi003.stdout: libpq-13.5-1.el8.x86_64 2023-03-06T14:14:55.644 INFO:teuthology.orchestra.run.smithi003.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-03-06T14:14:55.644 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-03-06T14:14:55.644 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.645 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.645 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-03-06T14:14:55.645 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.646 INFO:teuthology.orchestra.run.smithi003.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-03-06T14:14:55.646 INFO:teuthology.orchestra.run.smithi003.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-03-06T14:14:55.646 INFO:teuthology.orchestra.run.smithi003.stdout: libtool-2.4.6-25.el8.x86_64 2023-03-06T14:14:55.647 INFO:teuthology.orchestra.run.smithi003.stdout: libunwind-1.3.1-3.el8.x86_64 2023-03-06T14:14:55.647 INFO:teuthology.orchestra.run.smithi003.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-03-06T14:14:55.647 INFO:teuthology.orchestra.run.smithi003.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-03-06T14:14:55.647 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-03-06T14:14:55.648 INFO:teuthology.orchestra.run.smithi003.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-03-06T14:14:55.648 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-0.3.15-3.el8.x86_64 2023-03-06T14:14:55.648 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-03-06T14:14:55.649 INFO:teuthology.orchestra.run.smithi003.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-03-06T14:14:55.649 INFO:teuthology.orchestra.run.smithi003.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-03-06T14:14:55.649 INFO:teuthology.orchestra.run.smithi003.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-03-06T14:14:55.649 INFO:teuthology.orchestra.run.smithi003.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-03-06T14:14:55.650 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-06T14:14:55.650 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-06T14:14:55.650 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-06T14:14:55.650 INFO:teuthology.orchestra.run.smithi003.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-03-06T14:14:55.651 INFO:teuthology.orchestra.run.smithi003.stdout: python3-babel-2.5.1-7.el8.noarch 2023-03-06T14:14:55.651 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-03-06T14:14:55.651 INFO:teuthology.orchestra.run.smithi003.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-03-06T14:14:55.651 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-03-06T14:14:55.651 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.652 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.652 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.652 INFO:teuthology.orchestra.run.smithi003.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-03-06T14:14:55.653 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-03-06T14:14:55.653 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-03-06T14:14:55.653 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-03-06T14:14:55.653 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-03-06T14:14:55.653 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-03-06T14:14:55.654 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-6.2-6.el8.noarch 2023-03-06T14:14:55.654 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-03-06T14:14:55.654 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-03-06T14:14:55.654 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-03-06T14:14:55.654 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-03-06T14:14:55.654 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-03-06T14:14:55.654 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-03-06T14:14:55.654 INFO:teuthology.orchestra.run.smithi003.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-03-06T14:14:55.655 INFO:teuthology.orchestra.run.smithi003.stdout: python3-mako-1.0.6-13.el8.noarch 2023-03-06T14:14:55.655 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-03-06T14:14:55.655 INFO:teuthology.orchestra.run.smithi003.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-03-06T14:14:55.655 INFO:teuthology.orchestra.run.smithi003.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-03-06T14:14:55.655 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-03-06T14:14:55.655 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-03-06T14:14:55.655 INFO:teuthology.orchestra.run.smithi003.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-03-06T14:14:55.656 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-03-06T14:14:55.656 INFO:teuthology.orchestra.run.smithi003.stdout: python3-portend-2.6-1.el8.noarch 2023-03-06T14:14:55.656 INFO:teuthology.orchestra.run.smithi003.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-03-06T14:14:55.656 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-03-06T14:14:55.656 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-03-06T14:14:55.656 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-03-06T14:14:55.656 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pycparser-2.14-14.el8.noarch 2023-03-06T14:14:55.656 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytz-2017.2-9.el8.noarch 2023-03-06T14:14:55.657 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.657 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.657 INFO:teuthology.orchestra.run.smithi003.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-03-06T14:14:55.657 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-03-06T14:14:55.657 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.657 INFO:teuthology.orchestra.run.smithi003.stdout: python3-routes-2.4.1-12.el8.noarch 2023-03-06T14:14:55.657 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa-4.8-1.el8.noarch 2023-03-06T14:14:55.658 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-03-06T14:14:55.658 INFO:teuthology.orchestra.run.smithi003.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-03-06T14:14:55.658 INFO:teuthology.orchestra.run.smithi003.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-03-06T14:14:55.658 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-03-06T14:14:55.658 INFO:teuthology.orchestra.run.smithi003.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-03-06T14:14:55.658 INFO:teuthology.orchestra.run.smithi003.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-03-06T14:14:55.658 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-03-06T14:14:55.659 INFO:teuthology.orchestra.run.smithi003.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-03-06T14:14:55.659 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-03-06T14:14:55.659 INFO:teuthology.orchestra.run.smithi003.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-03-06T14:14:55.659 INFO:teuthology.orchestra.run.smithi003.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-03-06T14:14:55.659 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.659 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.659 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T14:14:55.659 INFO:teuthology.orchestra.run.smithi003.stdout: socat-1.7.4.1-1.el8.x86_64 2023-03-06T14:14:55.660 INFO:teuthology.orchestra.run.smithi003.stdout: thrift-0.13.0-2.el8.x86_64 2023-03-06T14:14:55.660 INFO:teuthology.orchestra.run.smithi003.stdout: uuid-1.6.2-43.el8.x86_64 2023-03-06T14:14:55.660 INFO:teuthology.orchestra.run.smithi003.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-03-06T14:14:55.660 INFO:teuthology.orchestra.run.smithi003.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-03-06T14:14:55.661 INFO:teuthology.orchestra.run.smithi003.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-03-06T14:14:55.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:55.661 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2023-03-06T14:14:55.848 DEBUG:teuthology.parallel:result is None 2023-03-06T14:14:55.849 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-06T14:14:55.992 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-03-06T14:14:56.015 INFO:teuthology.orchestra.run.smithi003.stdout:18.0.0-2739.g472aaef4.el8 2023-03-06T14:14:56.016 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2739.g472aaef4.el8 2023-03-06T14:14:56.016 INFO:teuthology.task.install:The correct ceph version 18.0.0-2739.g472aaef4 is installed. 2023-03-06T14:14:56.017 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-06T14:14:56.157 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-03-06T14:14:56.184 INFO:teuthology.orchestra.run.smithi136.stdout:18.0.0-2739.g472aaef4.el8 2023-03-06T14:14:56.185 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2739.g472aaef4.el8 2023-03-06T14:14:56.185 INFO:teuthology.task.install:The correct ceph version 18.0.0-2739.g472aaef4 is installed. 2023-03-06T14:14:56.186 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-03-06T14:14:56.186 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:14:56.187 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-06T14:14:56.227 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:14:56.228 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-06T14:14:56.272 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-03-06T14:14:56.272 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:14:56.272 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/daemon-helper 2023-03-06T14:14:56.299 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-06T14:14:56.367 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:14:56.367 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2023-03-06T14:14:56.397 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-06T14:14:56.465 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-03-06T14:14:56.466 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:14:56.466 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-06T14:14:56.493 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-06T14:14:56.560 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:14:56.561 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-06T14:14:56.589 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-06T14:14:56.657 INFO:teuthology.run_tasks:Running task ceph... 2023-03-06T14:14:56.729 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-03-06T14:14:56.730 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 777 /var/log/ceph 2023-03-06T14:14:56.732 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /var/log/ceph 2023-03-06T14:14:56.759 INFO:tasks.ceph:Disabling ceph logrotate... 2023-03-06T14:14:56.759 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /etc/logrotate.d/ceph 2023-03-06T14:14:56.800 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/logrotate.d/ceph 2023-03-06T14:14:56.828 INFO:tasks.ceph:Creating extra log directories... 2023-03-06T14:14:56.828 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-03-06T14:14:56.867 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-03-06T14:14:56.901 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-03-06T14:14:56.902 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-03-06T14:14:56.902 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-03-06T14:14:56.903 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:14:56.903 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-03-06T14:14:56.950 DEBUG:teuthology.orchestra.run.smithi003:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-03-06T14:14:57.088 DEBUG:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-03-06T14:14:57.115 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:14:57.115 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-03-06T14:14:57.133 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-03-06T14:14:57.269 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-03-06T14:14:57.301 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-03-06T14:14:57.302 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-03-06T14:14:57.302 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7195216', 'branch': 'wip-vshankar-testing-20230303.023823', 'description': 'fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7195216', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '75534f74ac3dd06f86697ff862e8be2945b3c8e6'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230303.023823'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230303.023823', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 30, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230303.023823', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi003.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi136.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '75534f74ac3dd06f86697ff862e8be2945b3c8e6'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}}, {'ceph': None}, {'kclient': None}, {'workunit': {'clients': {'all': ['fs/snaps']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'a2dfb0599b24ec4a1585108a2792a4567ce0a378', 'timestamp': '2023-03-06_13:28:53', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.31660'} 2023-03-06T14:14:57.303 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-03-06T14:14:57.305 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-03-06T14:14:57.353 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/run/ceph 2023-03-06T14:14:57.366 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/run/ceph 2023-03-06T14:14:57.419 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:14:57.419 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/scratch_devs of=/dev/stdout 2023-03-06T14:14:57.448 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-03-06T14:14:57.448 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_1 2023-03-06T14:14:57.505 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-03-06T14:14:57.505 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-06T14:14:57.505 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 356171 Links: 1 2023-03-06T14:14:57.505 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-06T14:14:57.506 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2023-03-06T14:14:57.506 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-03-06 14:14:48.813610078 +0000 2023-03-06T14:14:57.506 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-03-06 14:12:14.277069879 +0000 2023-03-06T14:14:57.506 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-03-06 14:12:14.277069879 +0000 2023-03-06T14:14:57.506 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2023-03-06T14:14:57.506 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-03-06T14:14:57.570 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-03-06T14:14:57.571 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-03-06T14:14:57.571 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000249873 s, 2.0 MB/s 2023-03-06T14:14:57.572 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-03-06T14:14:57.630 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_2 2023-03-06T14:14:57.687 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-03-06T14:14:57.688 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-06T14:14:57.688 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 356198 Links: 1 2023-03-06T14:14:57.688 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-06T14:14:57.688 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2023-03-06T14:14:57.688 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-03-06 14:14:48.813610078 +0000 2023-03-06T14:14:57.688 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-03-06 14:12:14.813062998 +0000 2023-03-06T14:14:57.688 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-03-06 14:12:14.813062998 +0000 2023-03-06T14:14:57.689 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2023-03-06T14:14:57.689 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-03-06T14:14:57.754 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-03-06T14:14:57.754 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-03-06T14:14:57.754 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000198389 s, 2.6 MB/s 2023-03-06T14:14:57.755 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-03-06T14:14:57.813 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_3 2023-03-06T14:14:57.870 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-03-06T14:14:57.870 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-06T14:14:57.870 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 363875 Links: 1 2023-03-06T14:14:57.870 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-06T14:14:57.871 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2023-03-06T14:14:57.871 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-03-06 14:14:48.813610078 +0000 2023-03-06T14:14:57.871 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-03-06 14:12:15.375055783 +0000 2023-03-06T14:14:57.871 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-03-06 14:12:15.375055783 +0000 2023-03-06T14:14:57.871 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2023-03-06T14:14:57.871 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-03-06T14:14:57.935 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-03-06T14:14:57.936 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-03-06T14:14:57.936 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000234663 s, 2.2 MB/s 2023-03-06T14:14:57.937 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-03-06T14:14:57.995 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_4 2023-03-06T14:14:58.052 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-03-06T14:14:58.052 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-06T14:14:58.052 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 356270 Links: 1 2023-03-06T14:14:58.053 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-06T14:14:58.053 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2023-03-06T14:14:58.053 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-03-06 14:14:48.813610078 +0000 2023-03-06T14:14:58.053 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-03-06 14:12:15.904048992 +0000 2023-03-06T14:14:58.053 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-03-06 14:12:15.904048992 +0000 2023-03-06T14:14:58.053 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2023-03-06T14:14:58.054 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-03-06T14:14:58.118 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-03-06T14:14:58.118 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-03-06T14:14:58.118 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000197719 s, 2.6 MB/s 2023-03-06T14:14:58.119 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-03-06T14:14:58.177 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-06T14:14:58.177 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:14:58.177 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/scratch_devs of=/dev/stdout 2023-03-06T14:14:58.196 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-03-06T14:14:58.196 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_1 2023-03-06T14:14:58.254 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-03-06T14:14:58.255 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-06T14:14:58.255 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 361155 Links: 1 2023-03-06T14:14:58.255 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-06T14:14:58.255 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2023-03-06T14:14:58.255 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2023-03-06 14:14:40.794875566 +0000 2023-03-06T14:14:58.255 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2023-03-06 14:12:08.979670441 +0000 2023-03-06T14:14:58.256 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2023-03-06 14:12:08.979670441 +0000 2023-03-06T14:14:58.256 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2023-03-06T14:14:58.256 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-03-06T14:14:58.324 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2023-03-06T14:14:58.324 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2023-03-06T14:14:58.324 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.0002746 s, 1.9 MB/s 2023-03-06T14:14:58.325 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-03-06T14:14:58.384 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_2 2023-03-06T14:14:58.442 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-03-06T14:14:58.443 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-06T14:14:58.443 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 359588 Links: 1 2023-03-06T14:14:58.443 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-06T14:14:58.443 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2023-03-06T14:14:58.443 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2023-03-06 14:14:40.794875566 +0000 2023-03-06T14:14:58.443 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2023-03-06 14:12:09.520658154 +0000 2023-03-06T14:14:58.443 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2023-03-06 14:12:09.520658154 +0000 2023-03-06T14:14:58.444 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2023-03-06T14:14:58.444 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-03-06T14:14:58.509 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2023-03-06T14:14:58.510 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2023-03-06T14:14:58.510 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000234461 s, 2.2 MB/s 2023-03-06T14:14:58.511 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-03-06T14:14:58.570 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_3 2023-03-06T14:14:58.627 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-03-06T14:14:58.627 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-06T14:14:58.627 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 361726 Links: 1 2023-03-06T14:14:58.628 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-06T14:14:58.628 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2023-03-06T14:14:58.628 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2023-03-06 14:14:40.794875566 +0000 2023-03-06T14:14:58.628 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2023-03-06 14:12:10.036646435 +0000 2023-03-06T14:14:58.628 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2023-03-06 14:12:10.036646435 +0000 2023-03-06T14:14:58.628 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2023-03-06T14:14:58.629 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-03-06T14:14:58.693 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2023-03-06T14:14:58.694 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2023-03-06T14:14:58.694 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000343234 s, 1.5 MB/s 2023-03-06T14:14:58.695 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-03-06T14:14:58.753 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_4 2023-03-06T14:14:58.810 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-03-06T14:14:58.811 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-06T14:14:58.811 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 361839 Links: 1 2023-03-06T14:14:58.811 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-06T14:14:58.812 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2023-03-06T14:14:58.812 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2023-03-06 14:14:40.794875566 +0000 2023-03-06T14:14:58.812 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2023-03-06 14:12:10.553634694 +0000 2023-03-06T14:14:58.812 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2023-03-06 14:12:10.553634694 +0000 2023-03-06T14:14:58.812 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2023-03-06T14:14:58.813 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-03-06T14:14:58.876 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2023-03-06T14:14:58.876 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2023-03-06T14:14:58.877 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000185833 s, 2.8 MB/s 2023-03-06T14:14:58.877 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-03-06T14:14:58.935 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-06T14:14:58.936 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi003.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-03-06T14:14:58.936 INFO:tasks.ceph:Generating config... 2023-03-06T14:14:58.937 INFO:tasks.ceph:[client] client mount timeout = 600 2023-03-06T14:14:58.938 INFO:tasks.ceph:[client] debug client = 20 2023-03-06T14:14:58.938 INFO:tasks.ceph:[client] debug ms = 1 2023-03-06T14:14:58.938 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-03-06T14:14:58.939 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-03-06T14:14:58.939 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-03-06T14:14:58.939 INFO:tasks.ceph:[mds] debug mds = 20 2023-03-06T14:14:58.939 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-03-06T14:14:58.939 INFO:tasks.ceph:[mds] debug ms = 1 2023-03-06T14:14:58.940 INFO:tasks.ceph:[mds] mds debug frag = True 2023-03-06T14:14:58.940 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-03-06T14:14:58.940 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-03-06T14:14:58.940 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-03-06T14:14:58.940 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-03-06T14:14:58.940 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-03-06T14:14:58.941 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-03-06T14:14:58.941 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-03-06T14:14:58.941 INFO:tasks.ceph:[mgr] debug ms = 1 2023-03-06T14:14:58.941 INFO:tasks.ceph:[mon] debug mon = 20 2023-03-06T14:14:58.941 INFO:tasks.ceph:[mon] debug ms = 1 2023-03-06T14:14:58.942 INFO:tasks.ceph:[mon] debug paxos = 20 2023-03-06T14:14:58.942 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-03-06T14:14:58.942 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-03-06T14:14:58.942 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-03-06T14:14:58.942 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-03-06T14:14:58.943 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-03-06T14:14:58.943 INFO:tasks.ceph:[osd] debug ms = 1 2023-03-06T14:14:58.943 INFO:tasks.ceph:[osd] debug osd = 20 2023-03-06T14:14:58.943 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-03-06T14:14:58.943 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-03-06T14:14:58.943 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-03-06T14:14:58.944 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-03-06T14:14:58.944 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-03-06T14:14:58.944 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-03-06T14:14:58.944 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-03-06T14:14:58.944 INFO:tasks.ceph:Setting up mon.a... 2023-03-06T14:14:58.945 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-03-06T14:14:59.001 INFO:teuthology.orchestra.run.smithi003.stdout:creating /etc/ceph/ceph.keyring 2023-03-06T14:14:59.004 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-03-06T14:14:59.053 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-06T14:14:59.082 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.3'), ('mon.b', '172.21.15.136'), ('mon.c', '[v2:172.21.15.136:3301,v1:172.21.15.136:6790]')] 2023-03-06T14:14:59.083 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.3,172.21.15.136,[v2:172.21.15.136:3301,v1:172.21.15.136:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-03-06T14:14:59.084 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:14:59.084 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-03-06T14:14:59.139 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.3 --add b 172.21.15.136 --addv c '[v2:172.21.15.136:3301,v1:172.21.15.136:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-03-06T14:14:59.230 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-03-06T14:14:59.230 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: generated fsid 9aae2361-5af0-49eb-8f99-e7f69834fedf 2023-03-06T14:14:59.231 INFO:teuthology.orchestra.run.smithi003.stdout:setting min_mon_release = pacific 2023-03-06T14:14:59.231 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 0 2023-03-06T14:14:59.231 INFO:teuthology.orchestra.run.smithi003.stdout:fsid 9aae2361-5af0-49eb-8f99-e7f69834fedf 2023-03-06T14:14:59.231 INFO:teuthology.orchestra.run.smithi003.stdout:last_changed 2023-03-06T14:14:59.229897+0000 2023-03-06T14:14:59.231 INFO:teuthology.orchestra.run.smithi003.stdout:created 2023-03-06T14:14:59.229897+0000 2023-03-06T14:14:59.231 INFO:teuthology.orchestra.run.smithi003.stdout:min_mon_release 16 (pacific) 2023-03-06T14:14:59.231 INFO:teuthology.orchestra.run.smithi003.stdout:election_strategy: 1 2023-03-06T14:14:59.232 INFO:teuthology.orchestra.run.smithi003.stdout:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-03-06T14:14:59.232 INFO:teuthology.orchestra.run.smithi003.stdout:1: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2023-03-06T14:14:59.232 INFO:teuthology.orchestra.run.smithi003.stdout:2: [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] mon.c 2023-03-06T14:14:59.232 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-03-06T14:14:59.233 DEBUG:teuthology.orchestra.run.smithi003:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-03-06T14:14:59.250 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9aae2361-5af0-49eb-8f99-e7f69834fedf... 2023-03-06T14:14:59.251 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-03-06T14:14:59.292 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-03-06T14:14:59.337 INFO:teuthology.orchestra.run.smithi003.stdout:[global] 2023-03-06T14:14:59.337 INFO:teuthology.orchestra.run.smithi003.stdout: chdir = "" 2023-03-06T14:14:59.337 INFO:teuthology.orchestra.run.smithi003.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-03-06T14:14:59.337 INFO:teuthology.orchestra.run.smithi003.stdout: auth supported = cephx 2023-03-06T14:14:59.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.342 INFO:teuthology.orchestra.run.smithi003.stdout: filestore xattr use omap = true 2023-03-06T14:14:59.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.343 INFO:teuthology.orchestra.run.smithi003.stdout: mon clock drift allowed = 1.000 2023-03-06T14:14:59.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.343 INFO:teuthology.orchestra.run.smithi003.stdout: osd crush chooseleaf type = 0 2023-03-06T14:14:59.343 INFO:teuthology.orchestra.run.smithi003.stdout: auth debug = true 2023-03-06T14:14:59.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.343 INFO:teuthology.orchestra.run.smithi003.stdout: ms die on old message = true 2023-03-06T14:14:59.343 INFO:teuthology.orchestra.run.smithi003.stdout: ms die on bug = true 2023-03-06T14:14:59.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.344 INFO:teuthology.orchestra.run.smithi003.stdout: mon max pg per osd = 10000 # >= luminous 2023-03-06T14:14:59.344 INFO:teuthology.orchestra.run.smithi003.stdout: mon pg warn max object skew = 0 2023-03-06T14:14:59.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.344 INFO:teuthology.orchestra.run.smithi003.stdout: # disable pg_autoscaler by default for new pools 2023-03-06T14:14:59.344 INFO:teuthology.orchestra.run.smithi003.stdout: osd_pool_default_pg_autoscale_mode = off 2023-03-06T14:14:59.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.344 INFO:teuthology.orchestra.run.smithi003.stdout: osd pool default size = 2 2023-03-06T14:14:59.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.345 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd allow primary affinity = true 2023-03-06T14:14:59.345 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd allow pg remap = true 2023-03-06T14:14:59.345 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on legacy crush tunables = false 2023-03-06T14:14:59.345 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on crush straw calc version zero = false 2023-03-06T14:14:59.345 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on no sortbitwise = false 2023-03-06T14:14:59.345 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on osd down out interval zero = false 2023-03-06T14:14:59.345 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on too few osds = false 2023-03-06T14:14:59.346 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-03-06T14:14:59.346 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_pool_no_redundancy = false 2023-03-06T14:14:59.346 INFO:teuthology.orchestra.run.smithi003.stdout: mon_allow_pool_size_one = true 2023-03-06T14:14:59.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.346 INFO:teuthology.orchestra.run.smithi003.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-03-06T14:14:59.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.346 INFO:teuthology.orchestra.run.smithi003.stdout: osd default data pool replay window = 5 2023-03-06T14:14:59.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.347 INFO:teuthology.orchestra.run.smithi003.stdout: mon allow pool delete = true 2023-03-06T14:14:59.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.347 INFO:teuthology.orchestra.run.smithi003.stdout: mon cluster log file level = debug 2023-03-06T14:14:59.347 INFO:teuthology.orchestra.run.smithi003.stdout: debug asserts on shutdown = true 2023-03-06T14:14:59.347 INFO:teuthology.orchestra.run.smithi003.stdout: mon health detail to clog = false 2023-03-06T14:14:59.347 INFO:teuthology.orchestra.run.smithi003.stdout: mon host = "172.21.15.3,172.21.15.136,[v2:172.21.15.136:3301,v1:172.21.15.136:6790]" 2023-03-06T14:14:59.347 INFO:teuthology.orchestra.run.smithi003.stdout: ms die on skipped message = False 2023-03-06T14:14:59.348 INFO:teuthology.orchestra.run.smithi003.stdout: fsid = 9aae2361-5af0-49eb-8f99-e7f69834fedf 2023-03-06T14:14:59.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.348 INFO:teuthology.orchestra.run.smithi003.stdout:[osd] 2023-03-06T14:14:59.348 INFO:teuthology.orchestra.run.smithi003.stdout: osd journal size = 100 2023-03-06T14:14:59.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.348 INFO:teuthology.orchestra.run.smithi003.stdout: osd scrub load threshold = 5.0 2023-03-06T14:14:59.348 INFO:teuthology.orchestra.run.smithi003.stdout: osd scrub max interval = 600 2023-03-06T14:14:59.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.349 INFO:teuthology.orchestra.run.smithi003.stdout: osd recover clone overlap = true 2023-03-06T14:14:59.349 INFO:teuthology.orchestra.run.smithi003.stdout: osd recovery max chunk = 1048576 2023-03-06T14:14:59.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.349 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug shutdown = true 2023-03-06T14:14:59.349 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug op order = true 2023-03-06T14:14:59.349 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug verify stray on activate = true 2023-03-06T14:14:59.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.349 INFO:teuthology.orchestra.run.smithi003.stdout: osd open classes on start = true 2023-03-06T14:14:59.350 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug pg log writeout = true 2023-03-06T14:14:59.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.350 INFO:teuthology.orchestra.run.smithi003.stdout: osd deep scrub update digest min age = 30 2023-03-06T14:14:59.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.350 INFO:teuthology.orchestra.run.smithi003.stdout: osd map max advance = 10 2023-03-06T14:14:59.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.350 INFO:teuthology.orchestra.run.smithi003.stdout: journal zero on create = true 2023-03-06T14:14:59.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.351 INFO:teuthology.orchestra.run.smithi003.stdout: filestore ondisk finisher threads = 3 2023-03-06T14:14:59.351 INFO:teuthology.orchestra.run.smithi003.stdout: filestore apply finisher threads = 3 2023-03-06T14:14:59.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.351 INFO:teuthology.orchestra.run.smithi003.stdout: bdev debug aio = true 2023-03-06T14:14:59.351 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug misdirected ops = true 2023-03-06T14:14:59.351 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore block size = 96636764160 2023-03-06T14:14:59.351 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore fsck on mount = True 2023-03-06T14:14:59.351 INFO:teuthology.orchestra.run.smithi003.stdout: debug bluefs = 20 2023-03-06T14:14:59.352 INFO:teuthology.orchestra.run.smithi003.stdout: debug bluestore = 20 2023-03-06T14:14:59.352 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-03-06T14:14:59.352 INFO:teuthology.orchestra.run.smithi003.stdout: debug osd = 20 2023-03-06T14:14:59.352 INFO:teuthology.orchestra.run.smithi003.stdout: debug rocksdb = 10 2023-03-06T14:14:59.352 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd backfillfull_ratio = 0.85 2023-03-06T14:14:59.352 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd full ratio = 0.9 2023-03-06T14:14:59.352 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd nearfull ratio = 0.8 2023-03-06T14:14:59.352 INFO:teuthology.orchestra.run.smithi003.stdout: osd failsafe full ratio = 0.95 2023-03-06T14:14:59.353 INFO:teuthology.orchestra.run.smithi003.stdout: osd objectstore = bluestore 2023-03-06T14:14:59.353 INFO:teuthology.orchestra.run.smithi003.stdout: osd op complaint time = 180 2023-03-06T14:14:59.353 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.353 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr] 2023-03-06T14:14:59.353 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-03-06T14:14:59.354 INFO:teuthology.orchestra.run.smithi003.stdout: debug mgr = 20 2023-03-06T14:14:59.354 INFO:teuthology.orchestra.run.smithi003.stdout: debug mon = 20 2023-03-06T14:14:59.354 INFO:teuthology.orchestra.run.smithi003.stdout: debug auth = 20 2023-03-06T14:14:59.354 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min pgs per osd = 4 2023-03-06T14:14:59.355 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min bytes per osd = 10 2023-03-06T14:14:59.355 INFO:teuthology.orchestra.run.smithi003.stdout: mgr/telemetry/nag = false 2023-03-06T14:14:59.355 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.355 INFO:teuthology.orchestra.run.smithi003.stdout:[mon] 2023-03-06T14:14:59.355 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-03-06T14:14:59.355 INFO:teuthology.orchestra.run.smithi003.stdout: debug mon = 20 2023-03-06T14:14:59.355 INFO:teuthology.orchestra.run.smithi003.stdout: debug paxos = 20 2023-03-06T14:14:59.356 INFO:teuthology.orchestra.run.smithi003.stdout: debug auth = 20 2023-03-06T14:14:59.356 INFO:teuthology.orchestra.run.smithi003.stdout: mon data avail warn = 5 2023-03-06T14:14:59.356 INFO:teuthology.orchestra.run.smithi003.stdout: mon mgr mkfs grace = 240 2023-03-06T14:14:59.356 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min pgs per osd = 4 2023-03-06T14:14:59.356 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd reporter subtree level = osd 2023-03-06T14:14:59.356 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd prime pg temp = true 2023-03-06T14:14:59.356 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min bytes per osd = 10 2023-03-06T14:14:59.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.357 INFO:teuthology.orchestra.run.smithi003.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-03-06T14:14:59.357 INFO:teuthology.orchestra.run.smithi003.stdout: auth mon ticket ttl = 660 # 11m 2023-03-06T14:14:59.357 INFO:teuthology.orchestra.run.smithi003.stdout: auth service ticket ttl = 240 # 4m 2023-03-06T14:14:59.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.357 INFO:teuthology.orchestra.run.smithi003.stdout: # don't complain about insecure global_id in the test suite 2023-03-06T14:14:59.357 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-03-06T14:14:59.357 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-03-06T14:14:59.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.358 INFO:teuthology.orchestra.run.smithi003.stdout: # 1m isn't quite enough 2023-03-06T14:14:59.358 INFO:teuthology.orchestra.run.smithi003.stdout: mon_down_mkfs_grace = 2m 2023-03-06T14:14:59.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.358 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_filestore_osds = false 2023-03-06T14:14:59.358 INFO:teuthology.orchestra.run.smithi003.stdout: mon op complaint time = 120 2023-03-06T14:14:59.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:14:59.358 INFO:teuthology.orchestra.run.smithi003.stdout:[client] 2023-03-06T14:14:59.358 INFO:teuthology.orchestra.run.smithi003.stdout: rgw cache enabled = true 2023-03-06T14:14:59.359 INFO:teuthology.orchestra.run.smithi003.stdout: rgw enable ops log = true 2023-03-06T14:14:59.359 INFO:teuthology.orchestra.run.smithi003.stdout: rgw enable usage log = true 2023-03-06T14:14:59.359 INFO:teuthology.orchestra.run.smithi003.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-03-06T14:14:59.359 INFO:teuthology.orchestra.run.smithi003.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-03-06T14:14:59.359 INFO:teuthology.orchestra.run.smithi003.stdout: client mount timeout = 600 2023-03-06T14:14:59.359 INFO:teuthology.orchestra.run.smithi003.stdout: debug client = 20 2023-03-06T14:14:59.359 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-03-06T14:14:59.359 INFO:teuthology.orchestra.run.smithi003.stdout: rados mon op timeout = 900 2023-03-06T14:14:59.360 INFO:teuthology.orchestra.run.smithi003.stdout: rados osd op timeout = 900 2023-03-06T14:14:59.360 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.a] 2023-03-06T14:14:59.360 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.b] 2023-03-06T14:14:59.360 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.c] 2023-03-06T14:14:59.360 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.a] 2023-03-06T14:14:59.360 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.c] 2023-03-06T14:14:59.360 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.b] 2023-03-06T14:14:59.361 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.d] 2023-03-06T14:14:59.361 INFO:teuthology.orchestra.run.smithi003.stdout:[mds] 2023-03-06T14:14:59.361 INFO:teuthology.orchestra.run.smithi003.stdout: debug mds = 20 2023-03-06T14:14:59.361 INFO:teuthology.orchestra.run.smithi003.stdout: debug mds balancer = 20 2023-03-06T14:14:59.361 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-03-06T14:14:59.361 INFO:teuthology.orchestra.run.smithi003.stdout: mds debug frag = True 2023-03-06T14:14:59.361 INFO:teuthology.orchestra.run.smithi003.stdout: mds debug scatterstat = True 2023-03-06T14:14:59.361 INFO:teuthology.orchestra.run.smithi003.stdout: mds op complaint time = 180 2023-03-06T14:14:59.362 INFO:teuthology.orchestra.run.smithi003.stdout: mds verify scatter = True 2023-03-06T14:14:59.362 INFO:teuthology.orchestra.run.smithi003.stdout: osd op complaint time = 180 2023-03-06T14:14:59.362 INFO:teuthology.orchestra.run.smithi003.stdout: rados mon op timeout = 900 2023-03-06T14:14:59.362 INFO:teuthology.orchestra.run.smithi003.stdout: rados osd op timeout = 900 2023-03-06T14:14:59.363 INFO:teuthology.orchestra.run.smithi136.stdout:[global] 2023-03-06T14:14:59.364 INFO:teuthology.orchestra.run.smithi136.stdout: chdir = "" 2023-03-06T14:14:59.364 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-03-06T14:14:59.364 INFO:teuthology.orchestra.run.smithi136.stdout: auth supported = cephx 2023-03-06T14:14:59.364 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.364 INFO:teuthology.orchestra.run.smithi136.stdout: filestore xattr use omap = true 2023-03-06T14:14:59.364 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.364 INFO:teuthology.orchestra.run.smithi136.stdout: mon clock drift allowed = 1.000 2023-03-06T14:14:59.365 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.365 INFO:teuthology.orchestra.run.smithi136.stdout: osd crush chooseleaf type = 0 2023-03-06T14:14:59.365 INFO:teuthology.orchestra.run.smithi136.stdout: auth debug = true 2023-03-06T14:14:59.365 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.365 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on old message = true 2023-03-06T14:14:59.365 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on bug = true 2023-03-06T14:14:59.365 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.366 INFO:teuthology.orchestra.run.smithi136.stdout: mon max pg per osd = 10000 # >= luminous 2023-03-06T14:14:59.366 INFO:teuthology.orchestra.run.smithi136.stdout: mon pg warn max object skew = 0 2023-03-06T14:14:59.366 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.366 INFO:teuthology.orchestra.run.smithi136.stdout: # disable pg_autoscaler by default for new pools 2023-03-06T14:14:59.366 INFO:teuthology.orchestra.run.smithi136.stdout: osd_pool_default_pg_autoscale_mode = off 2023-03-06T14:14:59.366 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.366 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default size = 2 2023-03-06T14:14:59.366 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.367 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow primary affinity = true 2023-03-06T14:14:59.367 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow pg remap = true 2023-03-06T14:14:59.367 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on legacy crush tunables = false 2023-03-06T14:14:59.367 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on crush straw calc version zero = false 2023-03-06T14:14:59.367 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on no sortbitwise = false 2023-03-06T14:14:59.367 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on osd down out interval zero = false 2023-03-06T14:14:59.367 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on too few osds = false 2023-03-06T14:14:59.368 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-03-06T14:14:59.368 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_no_redundancy = false 2023-03-06T14:14:59.368 INFO:teuthology.orchestra.run.smithi136.stdout: mon_allow_pool_size_one = true 2023-03-06T14:14:59.368 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.368 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-03-06T14:14:59.368 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.368 INFO:teuthology.orchestra.run.smithi136.stdout: osd default data pool replay window = 5 2023-03-06T14:14:59.368 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.369 INFO:teuthology.orchestra.run.smithi136.stdout: mon allow pool delete = true 2023-03-06T14:14:59.369 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.369 INFO:teuthology.orchestra.run.smithi136.stdout: mon cluster log file level = debug 2023-03-06T14:14:59.369 INFO:teuthology.orchestra.run.smithi136.stdout: debug asserts on shutdown = true 2023-03-06T14:14:59.369 INFO:teuthology.orchestra.run.smithi136.stdout: mon health detail to clog = false 2023-03-06T14:14:59.369 INFO:teuthology.orchestra.run.smithi136.stdout: mon host = "172.21.15.3,172.21.15.136,[v2:172.21.15.136:3301,v1:172.21.15.136:6790]" 2023-03-06T14:14:59.369 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on skipped message = False 2023-03-06T14:14:59.369 INFO:teuthology.orchestra.run.smithi136.stdout: fsid = 9aae2361-5af0-49eb-8f99-e7f69834fedf 2023-03-06T14:14:59.370 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.370 INFO:teuthology.orchestra.run.smithi136.stdout:[osd] 2023-03-06T14:14:59.370 INFO:teuthology.orchestra.run.smithi136.stdout: osd journal size = 100 2023-03-06T14:14:59.370 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.370 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub load threshold = 5.0 2023-03-06T14:14:59.370 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub max interval = 600 2023-03-06T14:14:59.370 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.371 INFO:teuthology.orchestra.run.smithi136.stdout: osd recover clone overlap = true 2023-03-06T14:14:59.371 INFO:teuthology.orchestra.run.smithi136.stdout: osd recovery max chunk = 1048576 2023-03-06T14:14:59.371 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.371 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug shutdown = true 2023-03-06T14:14:59.371 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug op order = true 2023-03-06T14:14:59.371 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify stray on activate = true 2023-03-06T14:14:59.371 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.371 INFO:teuthology.orchestra.run.smithi136.stdout: osd open classes on start = true 2023-03-06T14:14:59.372 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug pg log writeout = true 2023-03-06T14:14:59.372 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.372 INFO:teuthology.orchestra.run.smithi136.stdout: osd deep scrub update digest min age = 30 2023-03-06T14:14:59.372 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.372 INFO:teuthology.orchestra.run.smithi136.stdout: osd map max advance = 10 2023-03-06T14:14:59.372 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.372 INFO:teuthology.orchestra.run.smithi136.stdout: journal zero on create = true 2023-03-06T14:14:59.372 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.373 INFO:teuthology.orchestra.run.smithi136.stdout: filestore ondisk finisher threads = 3 2023-03-06T14:14:59.373 INFO:teuthology.orchestra.run.smithi136.stdout: filestore apply finisher threads = 3 2023-03-06T14:14:59.373 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.373 INFO:teuthology.orchestra.run.smithi136.stdout: bdev debug aio = true 2023-03-06T14:14:59.373 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug misdirected ops = true 2023-03-06T14:14:59.373 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore block size = 96636764160 2023-03-06T14:14:59.373 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore fsck on mount = True 2023-03-06T14:14:59.374 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluefs = 20 2023-03-06T14:14:59.374 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluestore = 20 2023-03-06T14:14:59.374 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2023-03-06T14:14:59.374 INFO:teuthology.orchestra.run.smithi136.stdout: debug osd = 20 2023-03-06T14:14:59.374 INFO:teuthology.orchestra.run.smithi136.stdout: debug rocksdb = 10 2023-03-06T14:14:59.374 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd backfillfull_ratio = 0.85 2023-03-06T14:14:59.374 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd full ratio = 0.9 2023-03-06T14:14:59.374 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd nearfull ratio = 0.8 2023-03-06T14:14:59.375 INFO:teuthology.orchestra.run.smithi136.stdout: osd failsafe full ratio = 0.95 2023-03-06T14:14:59.375 INFO:teuthology.orchestra.run.smithi136.stdout: osd objectstore = bluestore 2023-03-06T14:14:59.375 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2023-03-06T14:14:59.375 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.375 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr] 2023-03-06T14:14:59.375 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2023-03-06T14:14:59.375 INFO:teuthology.orchestra.run.smithi136.stdout: debug mgr = 20 2023-03-06T14:14:59.375 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2023-03-06T14:14:59.376 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2023-03-06T14:14:59.376 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2023-03-06T14:14:59.376 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2023-03-06T14:14:59.376 INFO:teuthology.orchestra.run.smithi136.stdout: mgr/telemetry/nag = false 2023-03-06T14:14:59.376 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.376 INFO:teuthology.orchestra.run.smithi136.stdout:[mon] 2023-03-06T14:14:59.376 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2023-03-06T14:14:59.377 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2023-03-06T14:14:59.377 INFO:teuthology.orchestra.run.smithi136.stdout: debug paxos = 20 2023-03-06T14:14:59.377 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2023-03-06T14:14:59.377 INFO:teuthology.orchestra.run.smithi136.stdout: mon data avail warn = 5 2023-03-06T14:14:59.377 INFO:teuthology.orchestra.run.smithi136.stdout: mon mgr mkfs grace = 240 2023-03-06T14:14:59.377 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2023-03-06T14:14:59.377 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd reporter subtree level = osd 2023-03-06T14:14:59.377 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd prime pg temp = true 2023-03-06T14:14:59.378 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2023-03-06T14:14:59.378 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.378 INFO:teuthology.orchestra.run.smithi136.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-03-06T14:14:59.378 INFO:teuthology.orchestra.run.smithi136.stdout: auth mon ticket ttl = 660 # 11m 2023-03-06T14:14:59.378 INFO:teuthology.orchestra.run.smithi136.stdout: auth service ticket ttl = 240 # 4m 2023-03-06T14:14:59.378 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.378 INFO:teuthology.orchestra.run.smithi136.stdout: # don't complain about insecure global_id in the test suite 2023-03-06T14:14:59.378 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-03-06T14:14:59.379 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-03-06T14:14:59.379 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.379 INFO:teuthology.orchestra.run.smithi136.stdout: # 1m isn't quite enough 2023-03-06T14:14:59.379 INFO:teuthology.orchestra.run.smithi136.stdout: mon_down_mkfs_grace = 2m 2023-03-06T14:14:59.379 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.379 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_filestore_osds = false 2023-03-06T14:14:59.379 INFO:teuthology.orchestra.run.smithi136.stdout: mon op complaint time = 120 2023-03-06T14:14:59.379 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-06T14:14:59.380 INFO:teuthology.orchestra.run.smithi136.stdout:[client] 2023-03-06T14:14:59.380 INFO:teuthology.orchestra.run.smithi136.stdout: rgw cache enabled = true 2023-03-06T14:14:59.380 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable ops log = true 2023-03-06T14:14:59.380 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable usage log = true 2023-03-06T14:14:59.380 INFO:teuthology.orchestra.run.smithi136.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-03-06T14:14:59.380 INFO:teuthology.orchestra.run.smithi136.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-03-06T14:14:59.380 INFO:teuthology.orchestra.run.smithi136.stdout: client mount timeout = 600 2023-03-06T14:14:59.381 INFO:teuthology.orchestra.run.smithi136.stdout: debug client = 20 2023-03-06T14:14:59.381 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2023-03-06T14:14:59.381 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 900 2023-03-06T14:14:59.381 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 900 2023-03-06T14:14:59.381 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.a] 2023-03-06T14:14:59.381 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.b] 2023-03-06T14:14:59.381 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.c] 2023-03-06T14:14:59.381 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2023-03-06T14:14:59.382 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.c] 2023-03-06T14:14:59.382 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2023-03-06T14:14:59.382 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.d] 2023-03-06T14:14:59.382 INFO:teuthology.orchestra.run.smithi136.stdout:[mds] 2023-03-06T14:14:59.382 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds = 20 2023-03-06T14:14:59.382 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds balancer = 20 2023-03-06T14:14:59.382 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2023-03-06T14:14:59.382 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug frag = True 2023-03-06T14:14:59.383 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug scatterstat = True 2023-03-06T14:14:59.383 INFO:teuthology.orchestra.run.smithi136.stdout: mds op complaint time = 180 2023-03-06T14:14:59.383 INFO:teuthology.orchestra.run.smithi136.stdout: mds verify scatter = True 2023-03-06T14:14:59.383 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2023-03-06T14:14:59.383 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 900 2023-03-06T14:14:59.383 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 900 2023-03-06T14:14:59.384 INFO:tasks.ceph:Creating admin key on mon.a... 2023-03-06T14:14:59.384 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-03-06T14:14:59.462 INFO:tasks.ceph:Copying monmap to all nodes... 2023-03-06T14:14:59.462 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:14:59.463 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-03-06T14:14:59.479 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:14:59.480 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-03-06T14:14:59.536 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi003.front.sepia.ceph.com 2023-03-06T14:14:59.537 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:14:59.537 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/ceph/ceph.keyring 2023-03-06T14:14:59.537 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-06T14:14:59.613 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:14:59.613 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-03-06T14:14:59.669 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi136.front.sepia.ceph.com 2023-03-06T14:14:59.669 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:14:59.670 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.keyring 2023-03-06T14:14:59.670 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-06T14:14:59.707 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:14:59.707 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-03-06T14:14:59.764 INFO:tasks.ceph:Setting up mon nodes... 2023-03-06T14:14:59.764 INFO:tasks.ceph:Setting up mgr nodes... 2023-03-06T14:14:59.765 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-03-06T14:14:59.820 INFO:teuthology.orchestra.run.smithi003.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-03-06T14:14:59.822 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-03-06T14:14:59.882 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-03-06T14:14:59.885 INFO:tasks.ceph:Setting up mds nodes... 2023-03-06T14:14:59.885 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-03-06T14:14:59.941 INFO:teuthology.orchestra.run.smithi003.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-03-06T14:14:59.943 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-03-06T14:14:59.970 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-03-06T14:15:00.064 INFO:teuthology.orchestra.run.smithi003.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-03-06T14:15:00.067 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-03-06T14:15:00.093 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-03-06T14:15:00.147 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-03-06T14:15:00.149 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-03-06T14:15:00.176 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-03-06T14:15:00.269 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-03-06T14:15:00.271 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-03-06T14:15:00.297 INFO:tasks.ceph_client:Setting up client nodes... 2023-03-06T14:15:00.297 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-03-06T14:15:00.342 INFO:teuthology.orchestra.run.smithi003.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-03-06T14:15:00.355 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-03-06T14:15:00.356 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi003.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-03-06T14:15:00.356 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-03-06T14:15:00.383 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-06T14:15:00.383 INFO:tasks.ceph:role: osd.0 2023-03-06T14:15:00.384 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com 2023-03-06T14:15:00.384 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-03-06T14:15:00.457 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-03-06T14:15:00.457 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-06T14:15:00.457 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-06T14:15:00.457 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-06T14:15:00.458 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-06T14:15:00.458 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-03-06T14:15:00.458 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-06T14:15:00.458 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-06T14:15:00.458 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-06T14:15:00.458 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-06T14:15:00.888 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2023-03-06T14:15:00.890 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-03-06T14:15:00.891 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-03-06T14:15:01.077 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-03-06T14:15:01.114 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-03-06T14:15:01.185 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-06T14:15:01.186 INFO:tasks.ceph:role: osd.1 2023-03-06T14:15:01.186 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi003.front.sepia.ceph.com 2023-03-06T14:15:01.186 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-03-06T14:15:01.262 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-03-06T14:15:01.263 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-06T14:15:01.263 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-06T14:15:01.263 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-06T14:15:01.263 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-06T14:15:01.263 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-03-06T14:15:01.263 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-06T14:15:01.263 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-06T14:15:01.264 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-06T14:15:01.264 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-06T14:15:01.673 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2023-03-06T14:15:01.675 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-03-06T14:15:01.675 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-03-06T14:15:01.785 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-03-06T14:15:01.819 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-03-06T14:15:01.888 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-06T14:15:01.888 INFO:tasks.ceph:role: osd.2 2023-03-06T14:15:01.889 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi003.front.sepia.ceph.com 2023-03-06T14:15:01.889 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-03-06T14:15:01.965 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-03-06T14:15:01.965 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-06T14:15:01.966 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-06T14:15:01.966 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-06T14:15:01.966 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-06T14:15:01.966 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-03-06T14:15:01.966 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-06T14:15:01.966 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-06T14:15:01.966 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-06T14:15:01.967 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-06T14:15:02.408 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2023-03-06T14:15:02.410 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-03-06T14:15:02.410 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-03-06T14:15:02.571 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-03-06T14:15:02.607 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-03-06T14:15:02.677 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-06T14:15:02.678 INFO:tasks.ceph:role: osd.3 2023-03-06T14:15:02.678 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi003.front.sepia.ceph.com 2023-03-06T14:15:02.678 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-03-06T14:15:02.755 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-03-06T14:15:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-06T14:15:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-06T14:15:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-06T14:15:02.756 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-06T14:15:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-03-06T14:15:02.756 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-06T14:15:02.756 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-06T14:15:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-06T14:15:02.757 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-06T14:15:03.183 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2023-03-06T14:15:03.185 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-03-06T14:15:03.185 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-03-06T14:15:03.364 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-03-06T14:15:03.401 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-06T14:15:03.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:03.514+0000 7f871988c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-03-06T14:15:03.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:03.514+0000 7f871988c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-03-06T14:15:03.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:03.514+0000 7f871988c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-06T14:15:03.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:03.514+0000 7f871988c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-06T14:15:03.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:03.514+0000 7f871988c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-06T14:15:03.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:03.515+0000 7f871988c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-03-06T14:15:06.381 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-03-06T14:15:06.415 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-06T14:15:06.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:06.508+0000 7f5203420640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-03-06T14:15:06.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:06.508+0000 7f5203420640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-03-06T14:15:06.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:06.508+0000 7f5203420640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-03-06T14:15:06.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:06.508+0000 7f5203420640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-03-06T14:15:06.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:06.508+0000 7f5203420640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-03-06T14:15:06.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:06.509+0000 7f5203420640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-03-06T14:15:09.377 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-03-06T14:15:09.411 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-06T14:15:09.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:09.504+0000 7f0bdf9c3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-03-06T14:15:09.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:09.504+0000 7f0bdf9c3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-03-06T14:15:09.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:09.504+0000 7f0bdf9c3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-03-06T14:15:09.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:09.504+0000 7f0bdf9c3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-03-06T14:15:09.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:09.504+0000 7f0bdf9c3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-03-06T14:15:09.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:09.505+0000 7f0bdf9c3640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-03-06T14:15:12.372 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-03-06T14:15:12.404 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-06T14:15:12.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:12.497+0000 7fed014b3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-03-06T14:15:12.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:12.497+0000 7fed014b3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-03-06T14:15:12.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:12.497+0000 7fed014b3640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-03-06T14:15:12.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:12.497+0000 7fed014b3640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-03-06T14:15:12.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:12.497+0000 7fed014b3640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-03-06T14:15:12.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:12.498+0000 7fed014b3640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-03-06T14:15:15.368 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-03-06T14:15:15.402 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-03-06T14:15:15.435 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-06T14:15:15.435 INFO:tasks.ceph:role: osd.4 2023-03-06T14:15:15.435 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com 2023-03-06T14:15:15.436 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-03-06T14:15:15.513 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-03-06T14:15:15.513 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-06T14:15:15.513 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-06T14:15:15.513 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-06T14:15:15.514 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-06T14:15:15.514 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2023-03-06T14:15:15.514 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-06T14:15:15.514 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-06T14:15:15.514 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-06T14:15:15.514 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-06T14:15:16.004 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2023-03-06T14:15:16.005 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2023-03-06T14:15:16.006 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-03-06T14:15:16.158 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-03-06T14:15:16.197 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-03-06T14:15:16.266 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-06T14:15:16.266 INFO:tasks.ceph:role: osd.5 2023-03-06T14:15:16.266 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi136.front.sepia.ceph.com 2023-03-06T14:15:16.267 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-03-06T14:15:16.341 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-03-06T14:15:16.342 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-06T14:15:16.342 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-06T14:15:16.342 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-06T14:15:16.342 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-06T14:15:16.342 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2023-03-06T14:15:16.342 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-06T14:15:16.343 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-06T14:15:16.343 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-06T14:15:16.343 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-06T14:15:16.806 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2023-03-06T14:15:16.808 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2023-03-06T14:15:16.808 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-03-06T14:15:16.921 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-03-06T14:15:16.954 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-03-06T14:15:17.024 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-06T14:15:17.024 INFO:tasks.ceph:role: osd.6 2023-03-06T14:15:17.025 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi136.front.sepia.ceph.com 2023-03-06T14:15:17.025 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-03-06T14:15:17.102 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-03-06T14:15:17.103 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-06T14:15:17.103 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-06T14:15:17.103 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-06T14:15:17.103 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-06T14:15:17.104 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2023-03-06T14:15:17.104 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-06T14:15:17.104 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-06T14:15:17.104 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-06T14:15:17.105 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-06T14:15:17.591 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2023-03-06T14:15:17.593 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2023-03-06T14:15:17.593 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-03-06T14:15:17.743 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-03-06T14:15:17.778 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-03-06T14:15:17.847 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-06T14:15:17.848 INFO:tasks.ceph:role: osd.7 2023-03-06T14:15:17.848 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi136.front.sepia.ceph.com 2023-03-06T14:15:17.849 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-03-06T14:15:17.924 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-03-06T14:15:17.924 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-06T14:15:17.924 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-06T14:15:17.925 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-06T14:15:17.925 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-06T14:15:17.925 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2023-03-06T14:15:17.925 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-06T14:15:17.925 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-06T14:15:17.925 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-06T14:15:17.925 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-06T14:15:18.414 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2023-03-06T14:15:18.416 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2023-03-06T14:15:18.416 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-03-06T14:15:18.566 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-03-06T14:15:18.604 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-06T14:15:18.708 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:18.707+0000 7fe047baf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-03-06T14:15:18.717 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:18.709+0000 7fe047baf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-03-06T14:15:18.718 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:18.709+0000 7fe047baf640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-03-06T14:15:18.718 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:18.709+0000 7fe047baf640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-03-06T14:15:18.718 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:18.709+0000 7fe047baf640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-03-06T14:15:18.718 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:18.710+0000 7fe047baf640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-03-06T14:15:21.575 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-03-06T14:15:21.608 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-06T14:15:21.700 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:21.698+0000 7f245d35c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-03-06T14:15:21.701 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:21.698+0000 7f245d35c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-03-06T14:15:21.701 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:21.698+0000 7f245d35c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-03-06T14:15:21.701 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:21.698+0000 7f245d35c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-03-06T14:15:21.701 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:21.698+0000 7f245d35c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-03-06T14:15:21.701 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:21.698+0000 7f245d35c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-03-06T14:15:24.563 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-03-06T14:15:24.595 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-06T14:15:24.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:24.683+0000 7f9a4547d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-03-06T14:15:24.686 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:24.683+0000 7f9a4547d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-03-06T14:15:24.686 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:24.683+0000 7f9a4547d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-03-06T14:15:24.686 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:24.683+0000 7f9a4547d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-03-06T14:15:24.686 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:24.683+0000 7f9a4547d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-03-06T14:15:24.686 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:24.684+0000 7f9a4547d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-03-06T14:15:27.304 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:15:27.307 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:15:27.556 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-03-06T14:15:27.587 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-06T14:15:27.677 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:27.675+0000 7f9b59208640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-03-06T14:15:27.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:27.675+0000 7f9b59208640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-03-06T14:15:27.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:27.675+0000 7f9b59208640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-03-06T14:15:27.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:27.675+0000 7f9b59208640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-03-06T14:15:27.678 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:27.675+0000 7f9b59208640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-03-06T14:15:27.679 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:27.676+0000 7f9b59208640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-03-06T14:15:30.550 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-03-06T14:15:30.581 INFO:tasks.ceph:Reading keys from all nodes... 2023-03-06T14:15:30.581 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:15:30.581 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-03-06T14:15:30.615 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:15:30.615 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-03-06T14:15:30.687 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:15:30.688 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-03-06T14:15:30.759 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:15:30.759 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-03-06T14:15:30.830 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:15:30.830 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-03-06T14:15:30.900 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:15:30.901 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-03-06T14:15:30.969 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:15:30.969 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-03-06T14:15:31.037 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:15:31.038 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-03-06T14:15:31.069 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:15:31.069 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-03-06T14:15:31.140 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:15:31.141 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-03-06T14:15:31.210 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:15:31.210 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-03-06T14:15:31.278 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:15:31.279 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-03-06T14:15:31.345 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:15:31.346 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-03-06T14:15:31.412 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:15:31.413 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-03-06T14:15:31.479 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:15:31.479 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-03-06T14:15:31.500 INFO:tasks.ceph:Adding keys to all mons... 2023-03-06T14:15:31.501 DEBUG:teuthology.orchestra.run.smithi003:> sudo tee -a /etc/ceph/ceph.keyring 2023-03-06T14:15:31.544 DEBUG:teuthology.orchestra.run.smithi136:> sudo tee -a /etc/ceph/ceph.keyring 2023-03-06T14:15:31.570 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr.y] 2023-03-06T14:15:31.570 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQBj9QVkcwnbMBAAJzQwIdXYPqePfo6vJ/wI7Q== 2023-03-06T14:15:31.570 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2023-03-06T14:15:31.570 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQBj9QVk4UcTOBAAY/px2W5JyESB2uR1qJmIyA== 2023-03-06T14:15:31.570 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.c] 2023-03-06T14:15:31.571 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQBk9QVknYTZAxAA2545dYpeO+Br01SjjTXa0w== 2023-03-06T14:15:31.571 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.0] 2023-03-06T14:15:31.571 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQBn9QVkXdK2HhAAcv/VjF6EK6aYGJlcrulXxg== 2023-03-06T14:15:31.571 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.1] 2023-03-06T14:15:31.571 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQBq9QVkPBhdHhAAmTtRTAvtzTdb3d5SeZwSEA== 2023-03-06T14:15:31.571 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.2] 2023-03-06T14:15:31.571 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQBt9QVkjiQZHhAAbuEKDDn1nEcJGnntmmlQZw== 2023-03-06T14:15:31.571 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.3] 2023-03-06T14:15:31.572 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQBw9QVkPsqvHRAAKJDprxNAtEwuugBMptyejg== 2023-03-06T14:15:31.572 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr.x] 2023-03-06T14:15:31.572 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQBj9QVkwUGTNBAAUp1ElLMVHALuu+1kT/8TSg== 2023-03-06T14:15:31.572 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2023-03-06T14:15:31.572 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQBk9QVkI6/BCBAA27RVxX2K5Lp/HUWWMLl9FQ== 2023-03-06T14:15:31.572 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.d] 2023-03-06T14:15:31.573 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQBk9QVkq8EDEBAAJxodZA1fWBotdOB6k1l2sw== 2023-03-06T14:15:31.573 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.4] 2023-03-06T14:15:31.573 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQB29QVkZVM3KhAAxIQu+dt55ZZ8JF6NGrfgQg== 2023-03-06T14:15:31.573 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.5] 2023-03-06T14:15:31.573 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQB59QVkyEO3KRAAq0lxxPPt6sL2Yc4qUIS/eg== 2023-03-06T14:15:31.573 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.6] 2023-03-06T14:15:31.573 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQB89QVk8vbUKBAAifwCp53aTy8+fIX6d3Imrw== 2023-03-06T14:15:31.573 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.7] 2023-03-06T14:15:31.574 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQB/9QVk56VcKBAAlsRvp2dlWzN3SXdBHftT8A== 2023-03-06T14:15:31.574 INFO:teuthology.orchestra.run.smithi136.stdout:[client.0] 2023-03-06T14:15:31.574 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQBk9QVksYpoFBAACEmrhSGqIKuKt9ZvbS4Hsw== 2023-03-06T14:15:31.575 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr.y] 2023-03-06T14:15:31.575 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBj9QVkcwnbMBAAJzQwIdXYPqePfo6vJ/wI7Q== 2023-03-06T14:15:31.575 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.a] 2023-03-06T14:15:31.576 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBj9QVk4UcTOBAAY/px2W5JyESB2uR1qJmIyA== 2023-03-06T14:15:31.576 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.c] 2023-03-06T14:15:31.576 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBk9QVknYTZAxAA2545dYpeO+Br01SjjTXa0w== 2023-03-06T14:15:31.576 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.0] 2023-03-06T14:15:31.576 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBn9QVkXdK2HhAAcv/VjF6EK6aYGJlcrulXxg== 2023-03-06T14:15:31.576 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.1] 2023-03-06T14:15:31.576 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBq9QVkPBhdHhAAmTtRTAvtzTdb3d5SeZwSEA== 2023-03-06T14:15:31.577 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.2] 2023-03-06T14:15:31.577 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBt9QVkjiQZHhAAbuEKDDn1nEcJGnntmmlQZw== 2023-03-06T14:15:31.577 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.3] 2023-03-06T14:15:31.577 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBw9QVkPsqvHRAAKJDprxNAtEwuugBMptyejg== 2023-03-06T14:15:31.577 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr.x] 2023-03-06T14:15:31.577 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBj9QVkwUGTNBAAUp1ElLMVHALuu+1kT/8TSg== 2023-03-06T14:15:31.577 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.b] 2023-03-06T14:15:31.577 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBk9QVkI6/BCBAA27RVxX2K5Lp/HUWWMLl9FQ== 2023-03-06T14:15:31.578 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.d] 2023-03-06T14:15:31.578 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBk9QVkq8EDEBAAJxodZA1fWBotdOB6k1l2sw== 2023-03-06T14:15:31.578 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.4] 2023-03-06T14:15:31.578 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQB29QVkZVM3KhAAxIQu+dt55ZZ8JF6NGrfgQg== 2023-03-06T14:15:31.578 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.5] 2023-03-06T14:15:31.578 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQB59QVkyEO3KRAAq0lxxPPt6sL2Yc4qUIS/eg== 2023-03-06T14:15:31.578 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.6] 2023-03-06T14:15:31.578 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQB89QVk8vbUKBAAifwCp53aTy8+fIX6d3Imrw== 2023-03-06T14:15:31.579 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.7] 2023-03-06T14:15:31.579 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQB/9QVk56VcKBAAlsRvp2dlWzN3SXdBHftT8A== 2023-03-06T14:15:31.579 INFO:teuthology.orchestra.run.smithi003.stdout:[client.0] 2023-03-06T14:15:31.579 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBk9QVksYpoFBAACEmrhSGqIKuKt9ZvbS4Hsw== 2023-03-06T14:15:31.579 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-06T14:15:31.617 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-06T14:15:31.675 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-06T14:15:31.678 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-06T14:15:31.735 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-06T14:15:31.738 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-06T14:15:31.794 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T14:15:31.796 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T14:15:31.850 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T14:15:31.852 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T14:15:31.906 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T14:15:31.909 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T14:15:31.962 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T14:15:31.965 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T14:15:32.017 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-06T14:15:32.019 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-06T14:15:32.072 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-06T14:15:32.075 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-06T14:15:32.131 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-06T14:15:32.133 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-06T14:15:32.189 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T14:15:32.192 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T14:15:32.244 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T14:15:32.247 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T14:15:32.299 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T14:15:32.302 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T14:15:32.354 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T14:15:32.357 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T14:15:32.409 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-06T14:15:32.412 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-06T14:15:32.467 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-03-06T14:15:32.468 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-03-06T14:15:32.494 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-03-06T14:15:32.594 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-03-06T14:15:32.622 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-03-06T14:15:32.648 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-03-06T14:15:32.745 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-03-06T14:15:32.772 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-03-06T14:15:32.838 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-03-06T14:15:32.935 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-03-06T14:15:32.961 DEBUG:teuthology.orchestra.run.smithi003:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-03-06T14:15:32.964 DEBUG:teuthology.orchestra.run.smithi136:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-03-06T14:15:33.018 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-03-06T14:15:33.019 INFO:tasks.ceph.mon.a:Restarting daemon 2023-03-06T14:15:33.019 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-03-06T14:15:33.022 INFO:tasks.ceph.mon.a:Started 2023-03-06T14:15:33.022 INFO:tasks.ceph.mon.b:Restarting daemon 2023-03-06T14:15:33.023 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-03-06T14:15:33.062 INFO:tasks.ceph.mon.b:Started 2023-03-06T14:15:33.062 INFO:tasks.ceph.mon.c:Restarting daemon 2023-03-06T14:15:33.063 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-03-06T14:15:33.065 INFO:tasks.ceph.mon.c:Started 2023-03-06T14:15:33.066 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-03-06T14:15:33.066 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-03-06T14:15:33.066 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-03-06T14:15:33.068 INFO:tasks.ceph.mgr.y:Started 2023-03-06T14:15:33.069 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-03-06T14:15:33.069 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-03-06T14:15:33.071 INFO:tasks.ceph.mgr.x:Started 2023-03-06T14:15:33.071 INFO:tasks.ceph:Setting crush tunables to default 2023-03-06T14:15:33.071 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd crush tunables default 2023-03-06T14:15:33.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.196+0000 7fdbce699700 1 Processor -- start 2023-03-06T14:15:33.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.196+0000 7fdbce699700 1 -- start start 2023-03-06T14:15:33.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.197+0000 7fdbce699700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdbc8146130 0x7fdbc814f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:33.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.197+0000 7fdbce699700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbc80b9070 0x7fdbc8156900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:33.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.197+0000 7fdbce699700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc814fab0 con 0x7fdbc80b8140 2023-03-06T14:15:33.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.197+0000 7fdbce699700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc806fc80 con 0x7fdbc8146130 2023-03-06T14:15:33.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.197+0000 7fdbce699700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc814cb30 con 0x7fdbc80b9070 2023-03-06T14:15:33.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.197+0000 7fdbc7fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdbc8146130 0x7fdbc814f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:33.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.197+0000 7fdbc7fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdbc8146130 0x7fdbc814f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54944/0 (socket says 172.21.15.3:54944) 2023-03-06T14:15:33.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.197+0000 7fdbc77fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fdbc80b8140 0x7fdbc806e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57218/0 (socket says 172.21.15.3:57218) 2023-03-06T14:15:33.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.197+0000 7fdbc7fff700 1 -- 172.21.15.3:0/4283684775 learned_addr learned my addr 172.21.15.3:0/4283684775 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:33.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.197+0000 7fdbc7fff700 1 -- 172.21.15.3:0/4283684775 >> v2:172.21.15.3:3300/0 conn(0x7fdbc8146130 msgr2=0x7fdbc814f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-03-06T14:15:33.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.197+0000 7fdbc7fff700 1 -- 172.21.15.3:0/4283684775 >> v2:172.21.15.3:3300/0 conn(0x7fdbc8146130 msgr2=0x7fdbc814f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-06T14:15:33.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.197+0000 7fdbc7fff700 1 --2- 172.21.15.3:0/4283684775 >> v2:172.21.15.3:3300/0 conn(0x7fdbc8146130 0x7fdbc814f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-06T14:15:33.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.198+0000 7fdbc7fff700 1 --2- 172.21.15.3:0/4283684775 >> v2:172.21.15.3:3300/0 conn(0x7fdbc8146130 0x7fdbc814f570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-06T14:15:33.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.198+0000 7fdbccc36700 1 --2- 172.21.15.3:0/4283684775 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbc80b9070 0x7fdbc8156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:33.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.198+0000 7fdbccc36700 1 -- 172.21.15.3:0/4283684775 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbc80b9070 msgr2=0x7fdbc8156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-06T14:15:33.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.198+0000 7fdbccc36700 1 -- 172.21.15.3:0/4283684775 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbc80b9070 msgr2=0x7fdbc8156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-06T14:15:33.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.198+0000 7fdbccc36700 1 --2- 172.21.15.3:0/4283684775 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbc80b9070 0x7fdbc8156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-06T14:15:33.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.198+0000 7fdbccc36700 1 --2- 172.21.15.3:0/4283684775 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbc80b9070 0x7fdbc8156900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-06T14:15:33.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.385+0000 7fdbc6ffd700 1 -- 172.21.15.3:0/4283684775 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751456685 0 0) 0x7fdbc814fab0 con 0x7fdbc80b8140 2023-03-06T14:15:33.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.385+0000 7fdbc6ffd700 1 -- 172.21.15.3:0/4283684775 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbb40035b0 con 0x7fdbc80b8140 2023-03-06T14:15:33.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.387+0000 7fdbc6ffd700 1 -- 172.21.15.3:0/4283684775 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3838321580 0 0) 0x7fdbb40035b0 con 0x7fdbc80b8140 2023-03-06T14:15:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.387+0000 7fdbc6ffd700 1 -- 172.21.15.3:0/4283684775 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbc80b9070 msgr2=0x7fdbc8156900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-06T14:15:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.387+0000 7fdbc6ffd700 1 --2- 172.21.15.3:0/4283684775 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbc80b9070 0x7fdbc8156900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.387+0000 7fdbc6ffd700 1 -- 172.21.15.3:0/4283684775 >> v2:172.21.15.3:3300/0 conn(0x7fdbc8146130 msgr2=0x7fdbc814f570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-06T14:15:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.387+0000 7fdbc6ffd700 1 --2- 172.21.15.3:0/4283684775 >> v2:172.21.15.3:3300/0 conn(0x7fdbc8146130 0x7fdbc814f570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.387+0000 7fdbc6ffd700 1 -- 172.21.15.3:0/4283684775 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc806f520 con 0x7fdbc80b8140 2023-03-06T14:15:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.387+0000 7fdbc6ffd700 1 -- 172.21.15.3:0/4283684775 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3255535284 0 0) 0x7fdbb0001670 con 0x7fdbc80b8140 2023-03-06T14:15:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.387+0000 7fdbc6ffd700 1 -- 172.21.15.3:0/4283684775 >> v1:172.21.15.3:6789/0 conn(0x7fdbc80b8140 legacy=0x7fdbc806e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:33.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.387+0000 7fdbc6ffd700 1 --2- 172.21.15.3:0/4283684775 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbc80b9070 0x7fdbb4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:33.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.388+0000 7fdbc6ffd700 1 --2- 172.21.15.3:0/4283684775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbb4004080 0x7fdbb4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:33.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.388+0000 7fdbc6ffd700 1 --2- 172.21.15.3:0/4283684775 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbb4004d90 0x7fdbb4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:33.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.388+0000 7fdbc6ffd700 1 -- 172.21.15.3:0/4283684775 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc806fc80 con 0x7fdbb4004080 2023-03-06T14:15:33.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.388+0000 7fdbc6ffd700 1 -- 172.21.15.3:0/4283684775 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc814cb30 con 0x7fdbb4004d90 2023-03-06T14:15:33.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.388+0000 7fdbc6ffd700 1 -- 172.21.15.3:0/4283684775 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb400bbf0 con 0x7fdbc80b9070 2023-03-06T14:15:33.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.388+0000 7fdbc7fff700 1 --2- 172.21.15.3:0/4283684775 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbc80b9070 0x7fdbb4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:33.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.388+0000 7fdbc77fe700 1 --2- 172.21.15.3:0/4283684775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbb4004080 0x7fdbb4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:33.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.388+0000 7fdbccc36700 1 --2- 172.21.15.3:0/4283684775 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbb4004d90 0x7fdbb4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:33.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.388+0000 7fdbc7fff700 1 -- 172.21.15.3:0/4283684775 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbb4004d90 msgr2=0x7fdbb4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:33.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.388+0000 7fdbc7fff700 1 --2- 172.21.15.3:0/4283684775 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbb4004d90 0x7fdbb4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:33.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.388+0000 7fdbc7fff700 1 -- 172.21.15.3:0/4283684775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbb4004080 msgr2=0x7fdbb4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:33.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.388+0000 7fdbc7fff700 1 --2- 172.21.15.3:0/4283684775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbb4004080 0x7fdbb4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:33.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.388+0000 7fdbc7fff700 1 -- 172.21.15.3:0/4283684775 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb40035b0 con 0x7fdbc80b9070 2023-03-06T14:15:33.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.388+0000 7fdbc77fe700 1 --2- 172.21.15.3:0/4283684775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbb4004080 0x7fdbb4004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:15:33.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.388+0000 7fdbc7fff700 1 --2- 172.21.15.3:0/4283684775 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbc80b9070 0x7fdbb4003a00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8006fa0 tx=0x7fdbb4005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d6840ed595cacf8 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:33.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.393+0000 7fdbc6ffd700 1 -- 172.21.15.3:0/4283684775 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb800b860 con 0x7fdbc80b9070 2023-03-06T14:15:33.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.393+0000 7fdbc6ffd700 1 -- 172.21.15.3:0/4283684775 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb8010d50 con 0x7fdbc80b9070 2023-03-06T14:15:33.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.393+0000 7fdbc6ffd700 1 -- 172.21.15.3:0/4283684775 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8005c60 con 0x7fdbc80b9070 2023-03-06T14:15:33.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.394+0000 7fdbce699700 1 -- 172.21.15.3:0/4283684775 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbc80b9070 msgr2=0x7fdbb4003a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:33.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.394+0000 7fdbce699700 1 --2- 172.21.15.3:0/4283684775 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbc80b9070 0x7fdbb4003a00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8006fa0 tx=0x7fdbb4005880 comp rx=0 tx=0).stop 2023-03-06T14:15:33.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.394+0000 7fdbccc36700 1 -- 172.21.15.3:0/4283684775 reap_dead start 2023-03-06T14:15:33.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.394+0000 7fdbce699700 1 -- 172.21.15.3:0/4283684775 shutdown_connections 2023-03-06T14:15:33.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.394+0000 7fdbce699700 1 -- 172.21.15.3:0/4283684775 >> 172.21.15.3:0/4283684775 conn(0x7fdbc80c2150 msgr2=0x7fdbc80c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:33.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.394+0000 7fdbce699700 1 -- 172.21.15.3:0/4283684775 shutdown_connections 2023-03-06T14:15:33.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.394+0000 7fdbce699700 1 -- 172.21.15.3:0/4283684775 wait complete. 2023-03-06T14:15:33.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.395+0000 7fdbce699700 1 Processor -- start 2023-03-06T14:15:33.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.395+0000 7fdbce699700 1 -- start start 2023-03-06T14:15:33.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.396+0000 7fdbce699700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbc80b9070 0x7fdbc81d5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:33.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.396+0000 7fdbce699700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbc814eba0 0x7fdbc813ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:33.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.396+0000 7fdbce699700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbc814b550 0x7fdbc81e3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:33.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.396+0000 7fdbce699700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc814dbf0 con 0x7fdbc80b9070 2023-03-06T14:15:33.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.396+0000 7fdbce699700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc81d6ef0 con 0x7fdbc814b550 2023-03-06T14:15:33.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.396+0000 7fdbce699700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc81d56b0 con 0x7fdbc814eba0 2023-03-06T14:15:33.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.396+0000 7fdbc7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbc80b9070 0x7fdbc81d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:33.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.396+0000 7fdbc7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbc80b9070 0x7fdbc81d5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54976/0 (socket says 172.21.15.3:54976) 2023-03-06T14:15:33.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.396+0000 7fdbc7fff700 1 -- 172.21.15.3:0/2805893891 learned_addr learned my addr 172.21.15.3:0/2805893891 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:33.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.396+0000 7fdbc77fe700 1 --2- 172.21.15.3:0/2805893891 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbc814eba0 0x7fdbc813ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:33.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.396+0000 7fdbccc36700 1 --2- 172.21.15.3:0/2805893891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbc814b550 0x7fdbc81e3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:33.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.397+0000 7fdbc7fff700 1 -- 172.21.15.3:0/2805893891 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbc814eba0 msgr2=0x7fdbc813ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:33.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.397+0000 7fdbc7fff700 1 --2- 172.21.15.3:0/2805893891 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbc814eba0 0x7fdbc813ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:33.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.397+0000 7fdbc7fff700 1 -- 172.21.15.3:0/2805893891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbc814b550 msgr2=0x7fdbc81e3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:33.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.397+0000 7fdbc7fff700 1 --2- 172.21.15.3:0/2805893891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbc814b550 0x7fdbc81e3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:33.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.397+0000 7fdbc7fff700 1 -- 172.21.15.3:0/2805893891 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc80b8870 con 0x7fdbc80b9070 2023-03-06T14:15:33.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.397+0000 7fdbc7fff700 1 --2- 172.21.15.3:0/2805893891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbc80b9070 0x7fdbc81d5b80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400bd80 tx=0x7fdbb80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:33.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.397+0000 7fdbc4ff9700 1 -- 172.21.15.3:0/2805893891 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb801d070 con 0x7fdbc80b9070 2023-03-06T14:15:33.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.397+0000 7fdbc4ff9700 1 -- 172.21.15.3:0/2805893891 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb8010ec0 con 0x7fdbc80b9070 2023-03-06T14:15:33.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.397+0000 7fdbc4ff9700 1 -- 172.21.15.3:0/2805893891 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8004450 con 0x7fdbc80b9070 2023-03-06T14:15:33.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.397+0000 7fdbce699700 1 -- 172.21.15.3:0/2805893891 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc806f9a0 con 0x7fdbc80b9070 2023-03-06T14:15:33.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.397+0000 7fdbce699700 1 -- 172.21.15.3:0/2805893891 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc80b8b50 con 0x7fdbc80b9070 2023-03-06T14:15:33.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.397+0000 7fdbc4ff9700 1 -- 172.21.15.3:0/2805893891 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fdbb8003990 con 0x7fdbc80b9070 2023-03-06T14:15:33.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.397+0000 7fdbc4ff9700 1 -- 172.21.15.3:0/2805893891 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdbb8020040 con 0x7fdbc80b9070 2023-03-06T14:15:33.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.398+0000 7fdbce699700 1 -- 172.21.15.3:0/2805893891 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc814df20 con 0x7fdbc80b9070 2023-03-06T14:15:33.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.402+0000 7fdbc4ff9700 1 -- 172.21.15.3:0/2805893891 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fdbb8032060 con 0x7fdbc80b9070 2023-03-06T14:15:33.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.479+0000 7fdbce699700 1 -- 172.21.15.3:0/2805893891 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fdbc814dd30 con 0x7fdbc80b9070 2023-03-06T14:15:33.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.484+0000 7fdbc4ff9700 1 -- 172.21.15.3:0/2805893891 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fdbb800b9c0 con 0x7fdbc80b9070 2023-03-06T14:15:33.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.485+0000 7fdbce699700 1 -- 172.21.15.3:0/2805893891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbc80b9070 msgr2=0x7fdbc81d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:33.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.485+0000 7fdbce699700 1 --2- 172.21.15.3:0/2805893891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbc80b9070 0x7fdbc81d5b80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400bd80 tx=0x7fdbb80047c0 comp rx=0 tx=0).stop 2023-03-06T14:15:33.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.485+0000 7fdbce699700 1 -- 172.21.15.3:0/2805893891 shutdown_connections 2023-03-06T14:15:33.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.485+0000 7fdbce699700 1 --2- 172.21.15.3:0/2805893891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdbc80b9070 0x7fdbc81d5b80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:33.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.485+0000 7fdbce699700 1 --2- 172.21.15.3:0/2805893891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbc814b550 0x7fdbc81e3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:33.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.485+0000 7fdbce699700 1 --2- 172.21.15.3:0/2805893891 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbc814eba0 0x7fdbc813ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:33.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.485+0000 7fdbce699700 1 -- 172.21.15.3:0/2805893891 >> 172.21.15.3:0/2805893891 conn(0x7fdbc80c2150 msgr2=0x7fdbc814aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:33.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.485+0000 7fdbce699700 1 -- 172.21.15.3:0/2805893891 shutdown_connections 2023-03-06T14:15:33.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:33.485+0000 7fdbce699700 1 -- 172.21.15.3:0/2805893891 wait complete. 2023-03-06T14:15:33.488 INFO:teuthology.orchestra.run.smithi003.stderr:adjusted tunables profile to default 2023-03-06T14:15:33.498 INFO:tasks.ceph:check_enable_crimson: False 2023-03-06T14:15:33.498 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-03-06T14:15:33.499 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:15:33.499 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-03-06T14:15:33.505 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:33.504+0000 7f8042485200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-06T14:15:33.510 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:33.510+0000 7f3b1cf55200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-06T14:15:33.526 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:15:33.526 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-03-06T14:15:33.569 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:33.568+0000 7f8042485200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-06T14:15:33.580 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:33.579+0000 7f3b1cf55200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-06T14:15:33.594 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:15:33.594 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-03-06T14:15:33.643 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:33.642+0000 7f8042485200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-06T14:15:33.661 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:15:33.661 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-03-06T14:15:33.662 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:33.659+0000 7f3b1cf55200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-06T14:15:33.720 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:33.719+0000 7f8042485200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-06T14:15:33.728 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:15:33.729 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-03-06T14:15:33.745 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:33.744+0000 7f3b1cf55200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-06T14:15:33.755 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:15:33.755 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-03-06T14:15:33.821 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:15:33.822 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-03-06T14:15:33.872 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:33.870+0000 7f8042485200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-06T14:15:33.887 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-06T14:15:33.888 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-03-06T14:15:33.894 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:33.893+0000 7f3b1cf55200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-06T14:15:33.954 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new c92c9e49-8a23-48a5-87e5-51f184f73a33 0 2023-03-06T14:15:34.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.113+0000 7f4b32e5d700 1 Processor -- start 2023-03-06T14:15:34.114 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.113+0000 7f4b32e5d700 1 -- start start 2023-03-06T14:15:34.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.113+0000 7f4b32e5d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4b2c0c1f50 0x7f4b2c0c2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:34.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.113+0000 7f4b32e5d700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2c0c13d0 con 0x7f4b2c0c0e00 2023-03-06T14:15:34.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.113+0000 7f4b32e5d700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2c0c1670 con 0x7f4b2c148de0 2023-03-06T14:15:34.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.113+0000 7f4b32e5d700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c14f4c0 con 0x7f4b2c0c1f50 2023-03-06T14:15:34.116 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.114+0000 7f4b30bf9700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4b2c0c1f50 0x7f4b2c0c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:34.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.114+0000 7f4b2bfff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f4b2c148de0 0x7f4b2c0c06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:33762/0 (socket says 172.21.15.136:33762) 2023-03-06T14:15:34.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.114+0000 7f4b2bfff700 1 -- 172.21.15.136:0/2077584708 learned_addr learned my addr 172.21.15.136:0/2077584708 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-03-06T14:15:34.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.114+0000 7f4b30bf9700 1 -- 172.21.15.136:0/2077584708 >> v1:172.21.15.136:6789/0 conn(0x7f4b2c148de0 legacy=0x7f4b2c0c06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.114+0000 7f4b30bf9700 1 -- 172.21.15.136:0/2077584708 >> v1:172.21.15.3:6789/0 conn(0x7f4b2c0c0e00 legacy=0x7f4b2c159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.114+0000 7f4b2b7fe700 1 -- 172.21.15.136:0/2077584708 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213858235 0 0) 0x7f4b2c0c1670 con 0x7f4b2c148de0 2023-03-06T14:15:34.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.114+0000 7f4b30bf9700 1 -- 172.21.15.136:0/2077584708 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c14f1e0 con 0x7f4b2c0c1f50 2023-03-06T14:15:34.117 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.114+0000 7f4b30bf9700 1 --2- 172.21.15.136:0/2077584708 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b2c0c1f50 0x7f4b2c0c2320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b24009d90 tx=0x7f4b2400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54bbc90396264306 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:34.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.114+0000 7f4b2b7fe700 1 -- 172.21.15.136:0/2077584708 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2400e070 con 0x7f4b2c0c1f50 2023-03-06T14:15:34.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.114+0000 7f4b2b7fe700 1 -- 172.21.15.136:0/2077584708 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2400bbd0 con 0x7f4b2c0c1f50 2023-03-06T14:15:34.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.114+0000 7f4b2b7fe700 1 -- 172.21.15.136:0/2077584708 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b24012430 con 0x7f4b2c0c1f50 2023-03-06T14:15:34.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.115+0000 7f4b32e5d700 1 -- 172.21.15.136:0/2077584708 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b2c0c1f50 msgr2=0x7f4b2c0c2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.115+0000 7f4b32e5d700 1 --2- 172.21.15.136:0/2077584708 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b2c0c1f50 0x7f4b2c0c2320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b24009d90 tx=0x7f4b2400b330 comp rx=0 tx=0).stop 2023-03-06T14:15:34.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.115+0000 7f4b32e5d700 1 -- 172.21.15.136:0/2077584708 shutdown_connections 2023-03-06T14:15:34.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.115+0000 7f4b32e5d700 1 --2- 172.21.15.136:0/2077584708 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b2c0c1f50 0x7f4b2c0c2320 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.118 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.115+0000 7f4b32e5d700 1 -- 172.21.15.136:0/2077584708 >> 172.21.15.136:0/2077584708 conn(0x7f4b2c06a2d0 msgr2=0x7f4b2c06a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:34.119 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.115+0000 7f4b32e5d700 1 -- 172.21.15.136:0/2077584708 shutdown_connections 2023-03-06T14:15:34.119 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.115+0000 7f4b32e5d700 1 -- 172.21.15.136:0/2077584708 wait complete. 2023-03-06T14:15:34.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.116+0000 7f4b32e5d700 1 Processor -- start 2023-03-06T14:15:34.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.116+0000 7f4b32e5d700 1 -- start start 2023-03-06T14:15:34.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.117+0000 7f4b32e5d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b2c0c0e00 0x7f4b2c1e5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:34.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.117+0000 7f4b32e5d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b2c0c1f50 0x7f4b2c1e4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:34.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.117+0000 7f4b32e5d700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b2c148de0 0x7f4b2c1e4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:34.121 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.117+0000 7f4b32e5d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0c02d0 con 0x7f4b2c0c1f50 2023-03-06T14:15:34.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.117+0000 7f4b32e5d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c1dbfe0 con 0x7f4b2c0c0e00 2023-03-06T14:15:34.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.117+0000 7f4b32e5d700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c1dc470 con 0x7f4b2c148de0 2023-03-06T14:15:34.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.117+0000 7f4b30bf9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b2c0c0e00 0x7f4b2c1e5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:34.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.117+0000 7f4b30bf9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b2c0c0e00 0x7f4b2c1e5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59766/0 (socket says 172.21.15.136:59766) 2023-03-06T14:15:34.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.117+0000 7f4b30bf9700 1 -- 172.21.15.136:0/3525218117 learned_addr learned my addr 172.21.15.136:0/3525218117 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-06T14:15:34.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.117+0000 7f4b313fa700 1 --2- 172.21.15.136:0/3525218117 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b2c148de0 0x7f4b2c1e4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:34.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.117+0000 7f4b2bfff700 1 --2- 172.21.15.136:0/3525218117 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b2c0c1f50 0x7f4b2c1e4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:34.122 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.118+0000 7f4b30bf9700 1 -- 172.21.15.136:0/3525218117 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b2c148de0 msgr2=0x7f4b2c1e4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.123 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.118+0000 7f4b30bf9700 1 --2- 172.21.15.136:0/3525218117 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b2c148de0 0x7f4b2c1e4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.123 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.118+0000 7f4b30bf9700 1 -- 172.21.15.136:0/3525218117 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b2c0c1f50 msgr2=0x7f4b2c1e4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.123 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.118+0000 7f4b30bf9700 1 --2- 172.21.15.136:0/3525218117 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b2c0c1f50 0x7f4b2c1e4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.123 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.118+0000 7f4b30bf9700 1 -- 172.21.15.136:0/3525218117 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b24009a70 con 0x7f4b2c0c0e00 2023-03-06T14:15:34.123 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.118+0000 7f4b313fa700 1 --2- 172.21.15.136:0/3525218117 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b2c148de0 0x7f4b2c1e4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:15:34.123 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.118+0000 7f4b30bf9700 1 --2- 172.21.15.136:0/3525218117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b2c0c0e00 0x7f4b2c1e5840 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4b24014040 tx=0x7f4b24004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:34.123 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.118+0000 7f4b297fa700 1 -- 172.21.15.136:0/3525218117 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2401b810 con 0x7f4b2c0c0e00 2023-03-06T14:15:34.124 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.118+0000 7f4b297fa700 1 -- 172.21.15.136:0/3525218117 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b24020070 con 0x7f4b2c0c0e00 2023-03-06T14:15:34.124 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.118+0000 7f4b32e5d700 1 -- 172.21.15.136:0/3525218117 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2c0bf720 con 0x7f4b2c0c0e00 2023-03-06T14:15:34.124 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.118+0000 7f4b297fa700 1 -- 172.21.15.136:0/3525218117 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2401bbf0 con 0x7f4b2c0c0e00 2023-03-06T14:15:34.124 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.118+0000 7f4b32e5d700 1 -- 172.21.15.136:0/3525218117 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2c0bfef0 con 0x7f4b2c0c0e00 2023-03-06T14:15:34.124 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.118+0000 7f4b297fa700 1 -- 172.21.15.136:0/3525218117 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f4b24027770 con 0x7f4b2c0c0e00 2023-03-06T14:15:34.124 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.118+0000 7f4b297fa700 1 -- 172.21.15.136:0/3525218117 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4b24022070 con 0x7f4b2c0c0e00 2023-03-06T14:15:34.124 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.119+0000 7f4b32e5d700 1 -- 172.21.15.136:0/3525218117 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2c0c2bf0 con 0x7f4b2c0c0e00 2023-03-06T14:15:34.125 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.121+0000 7f4b297fa700 1 -- 172.21.15.136:0/3525218117 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f4b24027be0 con 0x7f4b2c0c0e00 2023-03-06T14:15:34.205 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.204+0000 7f4b32e5d700 1 -- 172.21.15.136:0/3525218117 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c92c9e49-8a23-48a5-87e5-51f184f73a33", "id": 0} v 0) v1 -- 0x7f4b2c14e6a0 con 0x7f4b2c0c0e00 2023-03-06T14:15:34.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.210+0000 7f4b297fa700 1 -- 172.21.15.136:0/3525218117 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c92c9e49-8a23-48a5-87e5-51f184f73a33", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4b24027d80 con 0x7f4b2c0c0e00 2023-03-06T14:15:34.211 INFO:teuthology.orchestra.run.smithi136.stdout:0 2023-03-06T14:15:34.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.210+0000 7f4b32e5d700 1 -- 172.21.15.136:0/3525218117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b2c0c0e00 msgr2=0x7f4b2c1e5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.210+0000 7f4b32e5d700 1 --2- 172.21.15.136:0/3525218117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b2c0c0e00 0x7f4b2c1e5840 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4b24014040 tx=0x7f4b24004ad0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.211+0000 7f4b32e5d700 1 -- 172.21.15.136:0/3525218117 shutdown_connections 2023-03-06T14:15:34.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.211+0000 7f4b32e5d700 1 --2- 172.21.15.136:0/3525218117 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b2c148de0 0x7f4b2c1e4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.211+0000 7f4b32e5d700 1 --2- 172.21.15.136:0/3525218117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b2c0c0e00 0x7f4b2c1e5840 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.213 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.211+0000 7f4b32e5d700 1 --2- 172.21.15.136:0/3525218117 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b2c0c1f50 0x7f4b2c1e4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.213 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.211+0000 7f4b32e5d700 1 -- 172.21.15.136:0/3525218117 >> 172.21.15.136:0/3525218117 conn(0x7f4b2c06a2d0 msgr2=0x7f4b2c0c38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:34.213 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.211+0000 7f4b32e5d700 1 -- 172.21.15.136:0/3525218117 shutdown_connections 2023-03-06T14:15:34.213 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.211+0000 7f4b32e5d700 1 -- 172.21.15.136:0/3525218117 wait complete. 2023-03-06T14:15:34.224 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 86ec9127-843f-4246-bfbe-e14ce3af7d17 1 2023-03-06T14:15:34.343 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.342+0000 7f940d235700 1 Processor -- start 2023-03-06T14:15:34.344 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.342+0000 7f940d235700 1 -- start start 2023-03-06T14:15:34.346 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.343+0000 7f940d235700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f940806ea70 0x7f94080bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:34.346 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.343+0000 7f940d235700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f94080bdd60 0x7f940806c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:34.346 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.343+0000 7f940d235700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940814ff80 con 0x7f940806ee40 2023-03-06T14:15:34.346 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.343+0000 7f940d235700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94080b9070 con 0x7f94080bdd60 2023-03-06T14:15:34.346 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.343+0000 7f940d235700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94080bcb90 con 0x7f940806ea70 2023-03-06T14:15:34.347 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.343+0000 7f9406d9d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f940806ea70 0x7f94080bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:34.347 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.343+0000 7f940659c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f940806ee40 0x7f94081490f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:33774/0 (socket says 172.21.15.136:33774) 2023-03-06T14:15:34.347 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.343+0000 7f940659c700 1 -- 172.21.15.136:0/2575185485 learned_addr learned my addr 172.21.15.136:0/2575185485 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-03-06T14:15:34.347 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.343+0000 7f940759e700 1 --2- 172.21.15.136:0/2575185485 >> v2:172.21.15.3:3300/0 conn(0x7f94080bdd60 0x7f940806c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:34.347 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.343+0000 7f9405d9b700 1 -- 172.21.15.136:0/2575185485 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682807340 0 0) 0x7f940814ff80 con 0x7f940806ee40 2023-03-06T14:15:34.347 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.343+0000 7f9405d9b700 1 -- 172.21.15.136:0/2575185485 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93f00035b0 con 0x7f940806ee40 2023-03-06T14:15:34.347 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.343+0000 7f9406d9d700 1 -- 172.21.15.136:0/2575185485 >> v2:172.21.15.3:3300/0 conn(0x7f94080bdd60 msgr2=0x7f940806c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:34.347 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.343+0000 7f9406d9d700 1 --2- 172.21.15.136:0/2575185485 >> v2:172.21.15.3:3300/0 conn(0x7f94080bdd60 0x7f940806c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.348 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.343+0000 7f9406d9d700 1 -- 172.21.15.136:0/2575185485 >> v1:172.21.15.136:6789/0 conn(0x7f940806ee40 legacy=0x7f94081490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.348 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.343+0000 7f9406d9d700 1 -- 172.21.15.136:0/2575185485 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94080bce70 con 0x7f940806ea70 2023-03-06T14:15:34.348 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.344+0000 7f9406d9d700 1 --2- 172.21.15.136:0/2575185485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f940806ea70 0x7f94080bd670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9408072740 tx=0x7f93f8009b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4ededce6d7a1f8f server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:34.348 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.344+0000 7f9405d9b700 1 -- 172.21.15.136:0/2575185485 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f8005e30 con 0x7f940806ea70 2023-03-06T14:15:34.348 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.344+0000 7f9405d9b700 1 -- 172.21.15.136:0/2575185485 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f8006030 con 0x7f940806ea70 2023-03-06T14:15:34.348 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.344+0000 7f9405d9b700 1 -- 172.21.15.136:0/2575185485 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f80063c0 con 0x7f940806ea70 2023-03-06T14:15:34.348 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.344+0000 7f940d235700 1 -- 172.21.15.136:0/2575185485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f940806ea70 msgr2=0x7f94080bd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.349 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.344+0000 7f940d235700 1 --2- 172.21.15.136:0/2575185485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f940806ea70 0x7f94080bd670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9408072740 tx=0x7f93f8009b00 comp rx=0 tx=0).stop 2023-03-06T14:15:34.349 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.344+0000 7f940d235700 1 -- 172.21.15.136:0/2575185485 shutdown_connections 2023-03-06T14:15:34.349 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.344+0000 7f940d235700 1 --2- 172.21.15.136:0/2575185485 >> v2:172.21.15.3:3300/0 conn(0x7f94080bdd60 0x7f940806c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.349 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.344+0000 7f940d235700 1 --2- 172.21.15.136:0/2575185485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f940806ea70 0x7f94080bd670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.349 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.344+0000 7f940d235700 1 -- 172.21.15.136:0/2575185485 >> 172.21.15.136:0/2575185485 conn(0x7f94080c2150 msgr2=0x7f94080c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:34.350 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.344+0000 7f940d235700 1 -- 172.21.15.136:0/2575185485 shutdown_connections 2023-03-06T14:15:34.350 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.344+0000 7f940d235700 1 -- 172.21.15.136:0/2575185485 wait complete. 2023-03-06T14:15:34.352 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.346+0000 7f940d235700 1 Processor -- start 2023-03-06T14:15:34.352 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.346+0000 7f940d235700 1 -- start start 2023-03-06T14:15:34.352 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.346+0000 7f940d235700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f940806ea70 0x7f940814b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:34.352 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.346+0000 7f940d235700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f940806ee40 0x7f940806bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:34.352 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.346+0000 7f940d235700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94080bdd60 0x7f94081e4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:34.352 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.346+0000 7f940d235700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94080bc5d0 con 0x7f940806ee40 2023-03-06T14:15:34.352 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.346+0000 7f940d235700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9408148ca0 con 0x7f940806ea70 2023-03-06T14:15:34.353 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.346+0000 7f940d235700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940814a420 con 0x7f94080bdd60 2023-03-06T14:15:34.353 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.346+0000 7f9406d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f940806ea70 0x7f940814b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:34.353 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.346+0000 7f940759e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94080bdd60 0x7f94081e4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:34.353 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.347+0000 7f940759e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94080bdd60 0x7f94081e4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:50474/0 (socket says 172.21.15.136:50474) 2023-03-06T14:15:34.353 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.347+0000 7f9406d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f940806ea70 0x7f940814b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59778/0 (socket says 172.21.15.136:59778) 2023-03-06T14:15:34.353 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.347+0000 7f940759e700 1 -- 172.21.15.136:0/3423491090 learned_addr learned my addr 172.21.15.136:0/3423491090 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-06T14:15:34.354 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.347+0000 7f940659c700 1 --2- 172.21.15.136:0/3423491090 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f940806ee40 0x7f940806bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:34.354 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.347+0000 7f940759e700 1 -- 172.21.15.136:0/3423491090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f940806ea70 msgr2=0x7f940814b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.354 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.347+0000 7f940759e700 1 --2- 172.21.15.136:0/3423491090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f940806ea70 0x7f940814b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.354 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.347+0000 7f940759e700 1 -- 172.21.15.136:0/3423491090 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f940806ee40 msgr2=0x7f940806bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.354 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.347+0000 7f940759e700 1 --2- 172.21.15.136:0/3423491090 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f940806ee40 0x7f940806bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.354 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.347+0000 7f940759e700 1 -- 172.21.15.136:0/3423491090 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f8009430 con 0x7f94080bdd60 2023-03-06T14:15:34.354 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.347+0000 7f9406d9d700 1 --2- 172.21.15.136:0/3423491090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f940806ea70 0x7f940814b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:15:34.354 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.347+0000 7f940659c700 1 --2- 172.21.15.136:0/3423491090 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f940806ee40 0x7f940806bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:15:34.355 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.347+0000 7f940759e700 1 --2- 172.21.15.136:0/3423491090 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94080bdd60 0x7f94081e4540 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f940000efc0 tx=0x7f940000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:34.355 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.347+0000 7f93ef7fe700 1 -- 172.21.15.136:0/3423491090 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940000cc90 con 0x7f94080bdd60 2023-03-06T14:15:34.355 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.347+0000 7f93ef7fe700 1 -- 172.21.15.136:0/3423491090 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940000f040 con 0x7f94080bdd60 2023-03-06T14:15:34.355 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.347+0000 7f940d235700 1 -- 172.21.15.136:0/3423491090 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9408150220 con 0x7f94080bdd60 2023-03-06T14:15:34.355 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.347+0000 7f93ef7fe700 1 -- 172.21.15.136:0/3423491090 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94000146c0 con 0x7f94080bdd60 2023-03-06T14:15:34.355 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.347+0000 7f940d235700 1 -- 172.21.15.136:0/3423491090 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94080bd150 con 0x7f94080bdd60 2023-03-06T14:15:34.355 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.347+0000 7f93ef7fe700 1 -- 172.21.15.136:0/3423491090 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f9400014820 con 0x7f94080bdd60 2023-03-06T14:15:34.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.347+0000 7f93ef7fe700 1 -- 172.21.15.136:0/3423491090 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f940001db40 con 0x7f94080bdd60 2023-03-06T14:15:34.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.348+0000 7f940d235700 1 -- 172.21.15.136:0/3423491090 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94080b8b80 con 0x7f94080bdd60 2023-03-06T14:15:34.356 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.350+0000 7f93ef7fe700 1 -- 172.21.15.136:0/3423491090 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f940003bb00 con 0x7f94080bdd60 2023-03-06T14:15:34.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.433+0000 7f940d235700 1 -- 172.21.15.136:0/3423491090 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "86ec9127-843f-4246-bfbe-e14ce3af7d17", "id": 1} v 0) v1 -- 0x7f940814ff80 con 0x7f94080bdd60 2023-03-06T14:15:34.441 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.440+0000 7f93ef7fe700 1 -- 172.21.15.136:0/3423491090 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "86ec9127-843f-4246-bfbe-e14ce3af7d17", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f940002a070 con 0x7f94080bdd60 2023-03-06T14:15:34.442 INFO:teuthology.orchestra.run.smithi136.stdout:1 2023-03-06T14:15:34.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.441+0000 7f940d235700 1 -- 172.21.15.136:0/3423491090 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94080bdd60 msgr2=0x7f94081e4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.441+0000 7f940d235700 1 --2- 172.21.15.136:0/3423491090 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94080bdd60 0x7f94081e4540 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f940000efc0 tx=0x7f940000c3a0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.441+0000 7f940d235700 1 -- 172.21.15.136:0/3423491090 shutdown_connections 2023-03-06T14:15:34.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.441+0000 7f940d235700 1 --2- 172.21.15.136:0/3423491090 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94080bdd60 0x7f94081e4540 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.441+0000 7f940d235700 1 --2- 172.21.15.136:0/3423491090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f940806ea70 0x7f940814b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.441+0000 7f940d235700 1 --2- 172.21.15.136:0/3423491090 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f940806ee40 0x7f940806bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.441+0000 7f940d235700 1 -- 172.21.15.136:0/3423491090 >> 172.21.15.136:0/3423491090 conn(0x7f94080c2150 msgr2=0x7f94080c0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:34.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.441+0000 7f940d235700 1 -- 172.21.15.136:0/3423491090 shutdown_connections 2023-03-06T14:15:34.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.441+0000 7f940d235700 1 -- 172.21.15.136:0/3423491090 wait complete. 2023-03-06T14:15:34.455 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 67582de3-0f75-4cf0-84ca-e878986f99f6 2 2023-03-06T14:15:34.576 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.574+0000 7f9ad39c1700 1 Processor -- start 2023-03-06T14:15:34.576 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.575+0000 7f9ad39c1700 1 -- start start 2023-03-06T14:15:34.578 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.575+0000 7f9ad39c1700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9acc14da60 0x7f9acc06b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:34.578 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.575+0000 7f9ad39c1700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9acc14df60 con 0x7f9acc0be700 2023-03-06T14:15:34.578 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.575+0000 7f9ad39c1700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9acc06bed0 con 0x7f9acc146f60 2023-03-06T14:15:34.578 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.575+0000 7f9ad39c1700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc06c490 con 0x7f9acc14da60 2023-03-06T14:15:34.579 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.576+0000 7f9ad175d700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f9acc146f60 0x7f9acc06e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:33786/0 (socket says 172.21.15.136:33786) 2023-03-06T14:15:34.579 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.576+0000 7f9ad175d700 1 -- 172.21.15.136:0/2775891570 learned_addr learned my addr 172.21.15.136:0/2775891570 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-03-06T14:15:34.579 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.576+0000 7f9ad0f5c700 1 --2- 172.21.15.136:0/2775891570 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9acc14da60 0x7f9acc06b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:34.579 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.576+0000 7f9ac3fff700 1 -- 172.21.15.136:0/2775891570 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409922702 0 0) 0x7f9acc06bed0 con 0x7f9acc146f60 2023-03-06T14:15:34.579 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.576+0000 7f9ac3fff700 1 -- 172.21.15.136:0/2775891570 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ab80035b0 con 0x7f9acc146f60 2023-03-06T14:15:34.579 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.576+0000 7f9ad0f5c700 1 -- 172.21.15.136:0/2775891570 >> v1:172.21.15.136:6789/0 conn(0x7f9acc146f60 legacy=0x7f9acc06e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.579 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.576+0000 7f9ad0f5c700 1 -- 172.21.15.136:0/2775891570 >> v1:172.21.15.3:6789/0 conn(0x7f9acc0be700 legacy=0x7f9acc157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.580 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.576+0000 7f9ad0f5c700 1 -- 172.21.15.136:0/2775891570 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc06c1b0 con 0x7f9acc14da60 2023-03-06T14:15:34.580 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.576+0000 7f9ad0f5c700 1 --2- 172.21.15.136:0/2775891570 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9acc14da60 0x7f9acc06b220 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009870 tx=0x7f9abc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73d9c9386eedd2e9 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:34.580 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.576+0000 7f9ac3fff700 1 -- 172.21.15.136:0/2775891570 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc011830 con 0x7f9acc14da60 2023-03-06T14:15:34.580 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.576+0000 7f9ac3fff700 1 -- 172.21.15.136:0/2775891570 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc011990 con 0x7f9acc14da60 2023-03-06T14:15:34.580 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.576+0000 7f9ac3fff700 1 -- 172.21.15.136:0/2775891570 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc011d20 con 0x7f9acc14da60 2023-03-06T14:15:34.580 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:34.576+0000 7f8042485200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-06T14:15:34.582 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.577+0000 7f9ad39c1700 1 -- 172.21.15.136:0/2775891570 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9acc14da60 msgr2=0x7f9acc06b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.583 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.577+0000 7f9ad39c1700 1 --2- 172.21.15.136:0/2775891570 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9acc14da60 0x7f9acc06b220 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009870 tx=0x7f9abc009b80 comp rx=0 tx=0).stop 2023-03-06T14:15:34.583 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.577+0000 7f9ad39c1700 1 -- 172.21.15.136:0/2775891570 shutdown_connections 2023-03-06T14:15:34.583 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.577+0000 7f9ad39c1700 1 --2- 172.21.15.136:0/2775891570 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9acc14da60 0x7f9acc06b220 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.583 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.577+0000 7f9ad39c1700 1 -- 172.21.15.136:0/2775891570 >> 172.21.15.136:0/2775891570 conn(0x7f9acc0c2150 msgr2=0x7f9acc0c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:34.583 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.577+0000 7f9ad39c1700 1 -- 172.21.15.136:0/2775891570 shutdown_connections 2023-03-06T14:15:34.583 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.577+0000 7f9ad39c1700 1 -- 172.21.15.136:0/2775891570 wait complete. 2023-03-06T14:15:34.584 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.578+0000 7f9ad39c1700 1 Processor -- start 2023-03-06T14:15:34.584 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.578+0000 7f9ad39c1700 1 -- start start 2023-03-06T14:15:34.584 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.579+0000 7f9ad39c1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9acc0be700 0x7f9acc1e7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:34.584 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.579+0000 7f9ad39c1700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9acc146f60 0x7f9acc14faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:34.584 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.579+0000 7f9ad39c1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9acc14da60 0x7f9acc145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:34.584 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.579+0000 7f9ad39c1700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc0b85e0 con 0x7f9acc14da60 2023-03-06T14:15:34.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.579+0000 7f9ad39c1700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc14f5e0 con 0x7f9acc0be700 2023-03-06T14:15:34.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.579+0000 7f9ad39c1700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc1e8550 con 0x7f9acc146f60 2023-03-06T14:15:34.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.579+0000 7f9ad0f5c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9acc146f60 0x7f9acc14faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:34.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.579+0000 7f9ad175d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9acc0be700 0x7f9acc1e7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:34.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.579+0000 7f9ad0f5c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9acc146f60 0x7f9acc14faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:50484/0 (socket says 172.21.15.136:50484) 2023-03-06T14:15:34.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.579+0000 7f9ad0f5c700 1 -- 172.21.15.136:0/1325246504 learned_addr learned my addr 172.21.15.136:0/1325246504 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-06T14:15:34.585 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.579+0000 7f9ad1f5e700 1 --2- 172.21.15.136:0/1325246504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9acc14da60 0x7f9acc145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:34.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.579+0000 7f9ad0f5c700 1 -- 172.21.15.136:0/1325246504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9acc0be700 msgr2=0x7f9acc1e7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.579+0000 7f9ad0f5c700 1 --2- 172.21.15.136:0/1325246504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9acc0be700 0x7f9acc1e7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.579+0000 7f9ad0f5c700 1 -- 172.21.15.136:0/1325246504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9acc14da60 msgr2=0x7f9acc145400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.579+0000 7f9ad0f5c700 1 --2- 172.21.15.136:0/1325246504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9acc14da60 0x7f9acc145400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.579+0000 7f9ad0f5c700 1 -- 172.21.15.136:0/1325246504 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc0094a0 con 0x7f9acc146f60 2023-03-06T14:15:34.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.579+0000 7f9ad0f5c700 1 --2- 172.21.15.136:0/1325246504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9acc146f60 0x7f9acc14faa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0097c0 tx=0x7f9abc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:34.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.580+0000 7f9ac1ffb700 1 -- 172.21.15.136:0/1325246504 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0036a0 con 0x7f9acc146f60 2023-03-06T14:15:34.586 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.580+0000 7f9ac1ffb700 1 -- 172.21.15.136:0/1325246504 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc01e070 con 0x7f9acc146f60 2023-03-06T14:15:34.587 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.580+0000 7f9ac1ffb700 1 -- 172.21.15.136:0/1325246504 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc003a40 con 0x7f9acc146f60 2023-03-06T14:15:34.587 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.580+0000 7f9ad39c1700 1 -- 172.21.15.136:0/1325246504 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9acc06efa0 con 0x7f9acc146f60 2023-03-06T14:15:34.587 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.580+0000 7f9ad39c1700 1 -- 172.21.15.136:0/1325246504 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9acc06ad00 con 0x7f9acc146f60 2023-03-06T14:15:34.587 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.580+0000 7f9ac1ffb700 1 -- 172.21.15.136:0/1325246504 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f9abc00f050 con 0x7f9acc146f60 2023-03-06T14:15:34.587 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.580+0000 7f9ac1ffb700 1 -- 172.21.15.136:0/1325246504 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f9abc02d7c0 con 0x7f9acc146f60 2023-03-06T14:15:34.587 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.581+0000 7f9ad39c1700 1 -- 172.21.15.136:0/1325246504 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9acc147330 con 0x7f9acc146f60 2023-03-06T14:15:34.588 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.583+0000 7f9ac1ffb700 1 -- 172.21.15.136:0/1325246504 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f9abc044b00 con 0x7f9acc146f60 2023-03-06T14:15:34.599 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:34.597+0000 7f3b1cf55200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-06T14:15:34.663 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:34.662+0000 7f8042485200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-06T14:15:34.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.674+0000 7f9ad39c1700 1 -- 172.21.15.136:0/1325246504 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "67582de3-0f75-4cf0-84ca-e878986f99f6", "id": 2} v 0) v1 -- 0x7f9acc0b8750 con 0x7f9acc146f60 2023-03-06T14:15:34.677 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:34.676+0000 7f3b1cf55200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-06T14:15:34.683 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.682+0000 7f9ac1ffb700 1 -- 172.21.15.136:0/1325246504 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "67582de3-0f75-4cf0-84ca-e878986f99f6", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9abc033070 con 0x7f9acc146f60 2023-03-06T14:15:34.683 INFO:teuthology.orchestra.run.smithi136.stdout:2 2023-03-06T14:15:34.684 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.683+0000 7f9ad39c1700 1 -- 172.21.15.136:0/1325246504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9acc146f60 msgr2=0x7f9acc14faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.684 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.683+0000 7f9ad39c1700 1 --2- 172.21.15.136:0/1325246504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9acc146f60 0x7f9acc14faa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0097c0 tx=0x7f9abc004750 comp rx=0 tx=0).stop 2023-03-06T14:15:34.684 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.683+0000 7f9ad39c1700 1 -- 172.21.15.136:0/1325246504 shutdown_connections 2023-03-06T14:15:34.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.683+0000 7f9ad39c1700 1 --2- 172.21.15.136:0/1325246504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9acc14da60 0x7f9acc145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.683+0000 7f9ad39c1700 1 --2- 172.21.15.136:0/1325246504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9acc0be700 0x7f9acc1e7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.683+0000 7f9ad39c1700 1 --2- 172.21.15.136:0/1325246504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9acc146f60 0x7f9acc14faa0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.683+0000 7f9ad39c1700 1 -- 172.21.15.136:0/1325246504 >> 172.21.15.136:0/1325246504 conn(0x7f9acc0c2150 msgr2=0x7f9acc146700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:34.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.683+0000 7f9ad39c1700 1 -- 172.21.15.136:0/1325246504 shutdown_connections 2023-03-06T14:15:34.685 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.683+0000 7f9ad39c1700 1 -- 172.21.15.136:0/1325246504 wait complete. 2023-03-06T14:15:34.695 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 0fb8d708-4b38-4153-8a60-79741765d439 3 2023-03-06T14:15:34.744 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:34.742+0000 7f8042485200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-06T14:15:34.766 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:34.765+0000 7f3b1cf55200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-06T14:15:34.818 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.817+0000 7fe48179c700 1 Processor -- start 2023-03-06T14:15:34.819 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.817+0000 7fe48179c700 1 -- start start 2023-03-06T14:15:34.820 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.818+0000 7fe48179c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe47c0b8140 0x7fe47c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:34.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.818+0000 7fe48179c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47c06edd0 0x7fe47c156900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:34.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.818+0000 7fe48179c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c06fc80 con 0x7fe47c146130 2023-03-06T14:15:34.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.818+0000 7fe48179c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47c14cb30 con 0x7fe47c0b8140 2023-03-06T14:15:34.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.818+0000 7fe48179c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c06f520 con 0x7fe47c06edd0 2023-03-06T14:15:34.821 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.818+0000 7fe47b7fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47c06edd0 0x7fe47c156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:34.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.818+0000 7fe47b7fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47c06edd0 0x7fe47c156900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:50492/0 (socket says 172.21.15.136:50492) 2023-03-06T14:15:34.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.818+0000 7fe47b7fe700 1 -- 172.21.15.136:0/2355853467 learned_addr learned my addr 172.21.15.136:0/2355853467 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-06T14:15:34.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.819+0000 7fe47a7fc700 1 --2- 172.21.15.136:0/2355853467 >> v2:172.21.15.3:3300/0 conn(0x7fe47c0b8140 0x7fe47c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:34.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.819+0000 7fe47b7fe700 1 -- 172.21.15.136:0/2355853467 >> v2:172.21.15.3:3300/0 conn(0x7fe47c0b8140 msgr2=0x7fe47c06e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:34.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.819+0000 7fe47b7fe700 1 --2- 172.21.15.136:0/2355853467 >> v2:172.21.15.3:3300/0 conn(0x7fe47c0b8140 0x7fe47c06e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.819+0000 7fe47b7fe700 1 -- 172.21.15.136:0/2355853467 >> v1:172.21.15.3:6789/0 conn(0x7fe47c146130 legacy=0x7fe47c14f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.822 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.819+0000 7fe47b7fe700 1 -- 172.21.15.136:0/2355853467 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c06f9a0 con 0x7fe47c06edd0 2023-03-06T14:15:34.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.819+0000 7fe47b7fe700 1 --2- 172.21.15.136:0/2355853467 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47c06edd0 0x7fe47c156900 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe47400d150 tx=0x7fe47400d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24b930ce61822e83 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:34.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.819+0000 7fe479ffb700 1 -- 172.21.15.136:0/2355853467 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474010070 con 0x7fe47c06edd0 2023-03-06T14:15:34.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.819+0000 7fe479ffb700 1 -- 172.21.15.136:0/2355853467 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47400dd10 con 0x7fe47c06edd0 2023-03-06T14:15:34.823 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.819+0000 7fe479ffb700 1 -- 172.21.15.136:0/2355853467 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47400b310 con 0x7fe47c06edd0 2023-03-06T14:15:34.825 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.820+0000 7fe48179c700 1 -- 172.21.15.136:0/2355853467 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47c06edd0 msgr2=0x7fe47c156900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.820+0000 7fe48179c700 1 --2- 172.21.15.136:0/2355853467 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47c06edd0 0x7fe47c156900 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe47400d150 tx=0x7fe47400d460 comp rx=0 tx=0).stop 2023-03-06T14:15:34.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.820+0000 7fe48179c700 1 -- 172.21.15.136:0/2355853467 shutdown_connections 2023-03-06T14:15:34.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.820+0000 7fe48179c700 1 --2- 172.21.15.136:0/2355853467 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47c06edd0 0x7fe47c156900 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.820+0000 7fe48179c700 1 --2- 172.21.15.136:0/2355853467 >> v2:172.21.15.3:3300/0 conn(0x7fe47c0b8140 0x7fe47c06e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.826 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.820+0000 7fe48179c700 1 -- 172.21.15.136:0/2355853467 >> 172.21.15.136:0/2355853467 conn(0x7fe47c0c2150 msgr2=0x7fe47c0c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:34.827 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.820+0000 7fe48179c700 1 -- 172.21.15.136:0/2355853467 shutdown_connections 2023-03-06T14:15:34.827 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.820+0000 7fe48179c700 1 -- 172.21.15.136:0/2355853467 wait complete. 2023-03-06T14:15:34.827 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.821+0000 7fe48179c700 1 Processor -- start 2023-03-06T14:15:34.827 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.821+0000 7fe48179c700 1 -- start start 2023-03-06T14:15:34.827 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.822+0000 7fe48179c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe47c06edd0 0x7fe47c09d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:34.827 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.822+0000 7fe48179c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47c0b8140 0x7fe47c0b9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:34.828 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.822+0000 7fe48179c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe47c146130 0x7fe47c148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:34.828 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.822+0000 7fe48179c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c148300 con 0x7fe47c146130 2023-03-06T14:15:34.828 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.822+0000 7fe48179c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c09d8f0 con 0x7fe47c06edd0 2023-03-06T14:15:34.828 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.822+0000 7fe48179c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0b9670 con 0x7fe47c0b8140 2023-03-06T14:15:34.828 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.822+0000 7fe47a7fc700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47c0b8140 0x7fe47c0b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:34.828 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.822+0000 7fe47affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe47c06edd0 0x7fe47c09d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:34.828 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.822+0000 7fe47a7fc700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47c0b8140 0x7fe47c0b9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:50496/0 (socket says 172.21.15.136:50496) 2023-03-06T14:15:34.829 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.822+0000 7fe47a7fc700 1 -- 172.21.15.136:0/3147374447 learned_addr learned my addr 172.21.15.136:0/3147374447 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-06T14:15:34.829 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.822+0000 7fe47affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe47c06edd0 0x7fe47c09d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59802/0 (socket says 172.21.15.136:59802) 2023-03-06T14:15:34.829 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.822+0000 7fe47b7fe700 1 --2- 172.21.15.136:0/3147374447 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe47c146130 0x7fe47c148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:34.829 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.822+0000 7fe47a7fc700 1 -- 172.21.15.136:0/3147374447 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe47c06edd0 msgr2=0x7fe47c09d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.829 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.822+0000 7fe47a7fc700 1 --2- 172.21.15.136:0/3147374447 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe47c06edd0 0x7fe47c09d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.830 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.822+0000 7fe47a7fc700 1 -- 172.21.15.136:0/3147374447 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe47c146130 msgr2=0x7fe47c148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.830 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.822+0000 7fe47a7fc700 1 --2- 172.21.15.136:0/3147374447 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe47c146130 0x7fe47c148720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.830 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.822+0000 7fe47a7fc700 1 -- 172.21.15.136:0/3147374447 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47400bd40 con 0x7fe47c0b8140 2023-03-06T14:15:34.831 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.823+0000 7fe47a7fc700 1 --2- 172.21.15.136:0/3147374447 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47c0b8140 0x7fe47c0b9130 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe47000e9b0 tx=0x7fe47000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:34.831 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.823+0000 7fe4637fe700 1 -- 172.21.15.136:0/3147374447 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4700096b0 con 0x7fe47c0b8140 2023-03-06T14:15:34.831 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.823+0000 7fe4637fe700 1 -- 172.21.15.136:0/3147374447 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47000ee50 con 0x7fe47c0b8140 2023-03-06T14:15:34.832 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.823+0000 7fe48179c700 1 -- 172.21.15.136:0/3147374447 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe47c0b8b50 con 0x7fe47c0b8140 2023-03-06T14:15:34.832 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.823+0000 7fe4637fe700 1 -- 172.21.15.136:0/3147374447 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47000c9f0 con 0x7fe47c0b8140 2023-03-06T14:15:34.832 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.823+0000 7fe48179c700 1 -- 172.21.15.136:0/3147374447 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47c0b8870 con 0x7fe47c0b8140 2023-03-06T14:15:34.832 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.823+0000 7fe4637fe700 1 -- 172.21.15.136:0/3147374447 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fe470019030 con 0x7fe47c0b8140 2023-03-06T14:15:34.833 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.823+0000 7fe4637fe700 1 -- 172.21.15.136:0/3147374447 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fe4700065a0 con 0x7fe47c0b8140 2023-03-06T14:15:34.833 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.824+0000 7fe48179c700 1 -- 172.21.15.136:0/3147374447 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47c0b7110 con 0x7fe47c0b8140 2023-03-06T14:15:34.834 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.826+0000 7fe4637fe700 1 -- 172.21.15.136:0/3147374447 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fe470021060 con 0x7fe47c0b8140 2023-03-06T14:15:34.888 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:34.886+0000 7f8042485200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-06T14:15:34.907 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:34.906+0000 7f3b1cf55200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-06T14:15:34.910 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.909+0000 7fe48179c700 1 -- 172.21.15.136:0/3147374447 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0fb8d708-4b38-4153-8a60-79741765d439", "id": 3} v 0) v1 -- 0x7fe47c148440 con 0x7fe47c0b8140 2023-03-06T14:15:34.914 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.913+0000 7fe4637fe700 1 -- 172.21.15.136:0/3147374447 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0fb8d708-4b38-4153-8a60-79741765d439", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe47c148440 con 0x7fe47c0b8140 2023-03-06T14:15:34.914 INFO:teuthology.orchestra.run.smithi136.stdout:3 2023-03-06T14:15:34.915 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.914+0000 7fe48179c700 1 -- 172.21.15.136:0/3147374447 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47c0b8140 msgr2=0x7fe47c0b9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:34.915 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.914+0000 7fe48179c700 1 --2- 172.21.15.136:0/3147374447 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47c0b8140 0x7fe47c0b9130 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe47000e9b0 tx=0x7fe47000ecc0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.915 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.914+0000 7fe48179c700 1 -- 172.21.15.136:0/3147374447 shutdown_connections 2023-03-06T14:15:34.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.914+0000 7fe48179c700 1 --2- 172.21.15.136:0/3147374447 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe47c146130 0x7fe47c148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.914+0000 7fe48179c700 1 --2- 172.21.15.136:0/3147374447 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe47c06edd0 0x7fe47c09d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.914+0000 7fe48179c700 1 --2- 172.21.15.136:0/3147374447 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47c0b8140 0x7fe47c0b9130 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:34.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.914+0000 7fe48179c700 1 -- 172.21.15.136:0/3147374447 >> 172.21.15.136:0/3147374447 conn(0x7fe47c0c2150 msgr2=0x7fe47c0c1670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:34.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.914+0000 7fe48179c700 1 -- 172.21.15.136:0/3147374447 shutdown_connections 2023-03-06T14:15:34.916 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:34.914+0000 7fe48179c700 1 -- 172.21.15.136:0/3147374447 wait complete. 2023-03-06T14:15:34.927 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 44eb9d99-975f-43a3-8bf4-213b2ba6dea5 4 2023-03-06T14:15:35.047 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.046+0000 7fc81c7fa700 1 Processor -- start 2023-03-06T14:15:35.048 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.046+0000 7fc81c7fa700 1 -- start start 2023-03-06T14:15:35.049 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.047+0000 7fc81c7fa700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc814146130 0x7fc81414f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:35.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.047+0000 7fc81c7fa700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8140b8140 0x7fc81406e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:35.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.047+0000 7fc81c7fa700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81414fab0 con 0x7fc81406edd0 2023-03-06T14:15:35.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.047+0000 7fc81c7fa700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81406fc80 con 0x7fc814146130 2023-03-06T14:15:35.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.047+0000 7fc81c7fa700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81414cb30 con 0x7fc8140b8140 2023-03-06T14:15:35.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.047+0000 7fc819d95700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8140b8140 0x7fc81406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:35.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.047+0000 7fc81a596700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc814146130 0x7fc81414f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:35.050 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.047+0000 7fc81a596700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc814146130 0x7fc81414f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59808/0 (socket says 172.21.15.136:59808) 2023-03-06T14:15:35.051 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.047+0000 7fc819d95700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8140b8140 0x7fc81406e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:50500/0 (socket says 172.21.15.136:50500) 2023-03-06T14:15:35.051 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.047+0000 7fc81a596700 1 -- 172.21.15.136:0/1425691213 learned_addr learned my addr 172.21.15.136:0/1425691213 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-06T14:15:35.051 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.047+0000 7fc819d95700 1 -- 172.21.15.136:0/1425691213 >> v2:172.21.15.136:3300/0 conn(0x7fc814146130 msgr2=0x7fc81414f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:35.051 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.047+0000 7fc819d95700 1 --2- 172.21.15.136:0/1425691213 >> v2:172.21.15.136:3300/0 conn(0x7fc814146130 0x7fc81414f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.051 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.047+0000 7fc819d95700 1 -- 172.21.15.136:0/1425691213 >> v1:172.21.15.3:6789/0 conn(0x7fc81406edd0 legacy=0x7fc81406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.051 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.047+0000 7fc819d95700 1 -- 172.21.15.136:0/1425691213 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81406f520 con 0x7fc8140b8140 2023-03-06T14:15:35.051 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.047+0000 7fc81a596700 1 --2- 172.21.15.136:0/1425691213 >> v2:172.21.15.136:3300/0 conn(0x7fc814146130 0x7fc81414f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:15:35.052 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.047+0000 7fc819d95700 1 --2- 172.21.15.136:0/1425691213 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8140b8140 0x7fc81406e890 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc810009840 tx=0x7fc810009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b96040c1d71aa31 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:35.052 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.048+0000 7fc819594700 1 -- 172.21.15.136:0/1425691213 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810011830 con 0x7fc8140b8140 2023-03-06T14:15:35.052 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.048+0000 7fc819594700 1 -- 172.21.15.136:0/1425691213 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc810011990 con 0x7fc8140b8140 2023-03-06T14:15:35.052 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.048+0000 7fc819594700 1 -- 172.21.15.136:0/1425691213 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810011d20 con 0x7fc8140b8140 2023-03-06T14:15:35.052 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.048+0000 7fc81c7fa700 1 -- 172.21.15.136:0/1425691213 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8140b8140 msgr2=0x7fc81406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.052 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.048+0000 7fc81c7fa700 1 --2- 172.21.15.136:0/1425691213 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8140b8140 0x7fc81406e890 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc810009840 tx=0x7fc810009b50 comp rx=0 tx=0).stop 2023-03-06T14:15:35.052 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.048+0000 7fc81c7fa700 1 -- 172.21.15.136:0/1425691213 shutdown_connections 2023-03-06T14:15:35.053 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.048+0000 7fc81c7fa700 1 --2- 172.21.15.136:0/1425691213 >> v2:172.21.15.136:3300/0 conn(0x7fc814146130 0x7fc81414f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.053 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.048+0000 7fc81c7fa700 1 --2- 172.21.15.136:0/1425691213 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8140b8140 0x7fc81406e890 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.053 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.048+0000 7fc81c7fa700 1 -- 172.21.15.136:0/1425691213 >> 172.21.15.136:0/1425691213 conn(0x7fc8140c2150 msgr2=0x7fc8140c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:35.053 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.048+0000 7fc81c7fa700 1 -- 172.21.15.136:0/1425691213 shutdown_connections 2023-03-06T14:15:35.053 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.048+0000 7fc81c7fa700 1 -- 172.21.15.136:0/1425691213 wait complete. 2023-03-06T14:15:35.055 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.049+0000 7fc81c7fa700 1 Processor -- start 2023-03-06T14:15:35.055 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.050+0000 7fc81c7fa700 1 -- start start 2023-03-06T14:15:35.055 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.050+0000 7fc81c7fa700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc81406edd0 0x7fc8141507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:35.055 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.050+0000 7fc81c7fa700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8140b8140 0x7fc8140b93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:35.056 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.050+0000 7fc81c7fa700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc814146130 0x7fc8141e3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:35.056 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.050+0000 7fc81c7fa700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc814148630 con 0x7fc81406edd0 2023-03-06T14:15:35.056 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.050+0000 7fc81c7fa700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc814147ac0 con 0x7fc814146130 2023-03-06T14:15:35.056 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.050+0000 7fc81c7fa700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc814149140 con 0x7fc8140b8140 2023-03-06T14:15:35.056 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.050+0000 7fc819d95700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8140b8140 0x7fc8140b93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:35.056 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.050+0000 7fc81ad97700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc814146130 0x7fc8141e3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:35.056 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.050+0000 7fc819d95700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8140b8140 0x7fc8140b93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:50508/0 (socket says 172.21.15.136:50508) 2023-03-06T14:15:35.057 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.050+0000 7fc819d95700 1 -- 172.21.15.136:0/3374697838 learned_addr learned my addr 172.21.15.136:0/3374697838 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-06T14:15:35.057 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.050+0000 7fc81a596700 1 --2- 172.21.15.136:0/3374697838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc81406edd0 0x7fc8141507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:35.057 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.051+0000 7fc819d95700 1 -- 172.21.15.136:0/3374697838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc814146130 msgr2=0x7fc8141e3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.057 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.051+0000 7fc819d95700 1 --2- 172.21.15.136:0/3374697838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc814146130 0x7fc8141e3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.057 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.051+0000 7fc819d95700 1 -- 172.21.15.136:0/3374697838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc81406edd0 msgr2=0x7fc8141507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.057 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.051+0000 7fc819d95700 1 --2- 172.21.15.136:0/3374697838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc81406edd0 0x7fc8141507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.057 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.051+0000 7fc819d95700 1 -- 172.21.15.136:0/3374697838 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc804009500 con 0x7fc8140b8140 2023-03-06T14:15:35.058 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.051+0000 7fc819d95700 1 --2- 172.21.15.136:0/3374697838 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8140b8140 0x7fc8140b93b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc8100090b0 tx=0x7fc810004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:35.058 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.051+0000 7fc80affd700 1 -- 172.21.15.136:0/3374697838 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8100036a0 con 0x7fc8140b8140 2023-03-06T14:15:35.058 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.051+0000 7fc80affd700 1 -- 172.21.15.136:0/3374697838 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81001f070 con 0x7fc8140b8140 2023-03-06T14:15:35.058 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.051+0000 7fc81c7fa700 1 -- 172.21.15.136:0/3374697838 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8100094a0 con 0x7fc8140b8140 2023-03-06T14:15:35.058 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.051+0000 7fc80affd700 1 -- 172.21.15.136:0/3374697838 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810003a60 con 0x7fc8140b8140 2023-03-06T14:15:35.058 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.051+0000 7fc81c7fa700 1 -- 172.21.15.136:0/3374697838 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8140b8870 con 0x7fc8140b8140 2023-03-06T14:15:35.058 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.051+0000 7fc80affd700 1 -- 172.21.15.136:0/3374697838 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fc81000f050 con 0x7fc8140b8140 2023-03-06T14:15:35.058 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.051+0000 7fc80affd700 1 -- 172.21.15.136:0/3374697838 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc810021070 con 0x7fc8140b8140 2023-03-06T14:15:35.059 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.052+0000 7fc81c7fa700 1 -- 172.21.15.136:0/3374697838 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8140b8b50 con 0x7fc8140b8140 2023-03-06T14:15:35.059 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.054+0000 7fc80affd700 1 -- 172.21.15.136:0/3374697838 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fc810015020 con 0x7fc8140b8140 2023-03-06T14:15:35.137 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.136+0000 7fc81c7fa700 1 -- 172.21.15.136:0/3374697838 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "44eb9d99-975f-43a3-8bf4-213b2ba6dea5", "id": 4} v 0) v1 -- 0x7fc814149eb0 con 0x7fc8140b8140 2023-03-06T14:15:35.140 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.139+0000 7fc80affd700 1 -- 172.21.15.136:0/3374697838 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "44eb9d99-975f-43a3-8bf4-213b2ba6dea5", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc810003bc0 con 0x7fc8140b8140 2023-03-06T14:15:35.141 INFO:teuthology.orchestra.run.smithi136.stdout:4 2023-03-06T14:15:35.142 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.140+0000 7fc81c7fa700 1 -- 172.21.15.136:0/3374697838 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8140b8140 msgr2=0x7fc8140b93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.142 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.140+0000 7fc81c7fa700 1 --2- 172.21.15.136:0/3374697838 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8140b8140 0x7fc8140b93b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc8100090b0 tx=0x7fc810004750 comp rx=0 tx=0).stop 2023-03-06T14:15:35.142 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.140+0000 7fc81c7fa700 1 -- 172.21.15.136:0/3374697838 shutdown_connections 2023-03-06T14:15:35.142 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.140+0000 7fc81c7fa700 1 --2- 172.21.15.136:0/3374697838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc81406edd0 0x7fc8141507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.142 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.140+0000 7fc81c7fa700 1 --2- 172.21.15.136:0/3374697838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc814146130 0x7fc8141e3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.142 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.140+0000 7fc81c7fa700 1 --2- 172.21.15.136:0/3374697838 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8140b8140 0x7fc8140b93b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.143 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.140+0000 7fc81c7fa700 1 -- 172.21.15.136:0/3374697838 >> 172.21.15.136:0/3374697838 conn(0x7fc8140c2150 msgr2=0x7fc8140bdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:35.143 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.140+0000 7fc81c7fa700 1 -- 172.21.15.136:0/3374697838 shutdown_connections 2023-03-06T14:15:35.143 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.140+0000 7fc81c7fa700 1 -- 172.21.15.136:0/3374697838 wait complete. 2023-03-06T14:15:35.154 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new aff1a438-c444-4ebc-9806-d2d117878a2c 5 2023-03-06T14:15:35.274 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.272+0000 7f24ccb14700 1 Processor -- start 2023-03-06T14:15:35.274 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.272+0000 7f24ccb14700 1 -- start start 2023-03-06T14:15:35.276 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.273+0000 7f24ccb14700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24c806b430 0x7f24c806b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:35.276 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.273+0000 7f24ccb14700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f24c8146d40 0x7f24c81471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:35.276 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.273+0000 7f24ccb14700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c80a3260 con 0x7f24c81507d0 2023-03-06T14:15:35.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.273+0000 7f24ccb14700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c806efe0 con 0x7f24c8146d40 2023-03-06T14:15:35.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.273+0000 7f24ccb14700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c814dbf0 con 0x7f24c806b430 2023-03-06T14:15:35.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.273+0000 7f24c659c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24c806b430 0x7f24c806b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:35.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.273+0000 7f24c5d9b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f24c8146d40 0x7f24c81471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:35.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.273+0000 7f24c659c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24c806b430 0x7f24c806b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:50512/0 (socket says 172.21.15.136:50512) 2023-03-06T14:15:35.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.273+0000 7f24c6d9d700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f24c81507d0 0x7f24c8150bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:33824/0 (socket says 172.21.15.136:33824) 2023-03-06T14:15:35.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.273+0000 7f24c659c700 1 -- 172.21.15.136:0/135843414 learned_addr learned my addr 172.21.15.136:0/135843414 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-06T14:15:35.278 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.274+0000 7f24c659c700 1 -- 172.21.15.136:0/135843414 >> v2:172.21.15.136:3300/0 conn(0x7f24c8146d40 msgr2=0x7f24c81471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:35.278 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.274+0000 7f24c659c700 1 --2- 172.21.15.136:0/135843414 >> v2:172.21.15.136:3300/0 conn(0x7f24c8146d40 0x7f24c81471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.278 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.274+0000 7f24c659c700 1 -- 172.21.15.136:0/135843414 >> v1:172.21.15.136:6789/0 conn(0x7f24c81507d0 legacy=0x7f24c8150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.278 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.274+0000 7f24c659c700 1 -- 172.21.15.136:0/135843414 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c806f1f0 con 0x7f24c806b430 2023-03-06T14:15:35.278 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.274+0000 7f24c559a700 1 -- 172.21.15.136:0/135843414 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940260130 0 0) 0x7f24c0001490 con 0x7f24c81507d0 2023-03-06T14:15:35.278 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.274+0000 7f24c5d9b700 1 --2- 172.21.15.136:0/135843414 >> v2:172.21.15.136:3300/0 conn(0x7f24c8146d40 0x7f24c81471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:15:35.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.274+0000 7f24c659c700 1 --2- 172.21.15.136:0/135843414 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24c806b430 0x7f24c806b800 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f24b80098f0 tx=0x7f24b8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1a0bfd41aa3b2ac server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:35.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.274+0000 7f24c559a700 1 -- 172.21.15.136:0/135843414 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8011830 con 0x7f24c806b430 2023-03-06T14:15:35.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.274+0000 7f24c559a700 1 -- 172.21.15.136:0/135843414 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b8011990 con 0x7f24c806b430 2023-03-06T14:15:35.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.274+0000 7f24c559a700 1 -- 172.21.15.136:0/135843414 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8011d20 con 0x7f24c806b430 2023-03-06T14:15:35.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.275+0000 7f24ccb14700 1 -- 172.21.15.136:0/135843414 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24c806b430 msgr2=0x7f24c806b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.275+0000 7f24ccb14700 1 --2- 172.21.15.136:0/135843414 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24c806b430 0x7f24c806b800 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f24b80098f0 tx=0x7f24b8009c00 comp rx=0 tx=0).stop 2023-03-06T14:15:35.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.275+0000 7f24ccb14700 1 -- 172.21.15.136:0/135843414 shutdown_connections 2023-03-06T14:15:35.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.275+0000 7f24ccb14700 1 --2- 172.21.15.136:0/135843414 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24c806b430 0x7f24c806b800 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.275+0000 7f24ccb14700 1 --2- 172.21.15.136:0/135843414 >> v2:172.21.15.136:3300/0 conn(0x7f24c8146d40 0x7f24c81471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.275+0000 7f24ccb14700 1 -- 172.21.15.136:0/135843414 >> 172.21.15.136:0/135843414 conn(0x7f24c80c17d0 msgr2=0x7f24c80c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:35.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.275+0000 7f24ccb14700 1 -- 172.21.15.136:0/135843414 shutdown_connections 2023-03-06T14:15:35.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.275+0000 7f24ccb14700 1 -- 172.21.15.136:0/135843414 wait complete. 2023-03-06T14:15:35.282 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.276+0000 7f24ccb14700 1 Processor -- start 2023-03-06T14:15:35.282 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.276+0000 7f24ccb14700 1 -- start start 2023-03-06T14:15:35.282 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24ccb14700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24c806b430 0x7f24c80bf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:35.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24ccb14700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24c8146d40 0x7f24c8145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:35.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24ccb14700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24c81507d0 0x7f24c8143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:35.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24ccb14700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c80a27b0 con 0x7f24c8146d40 2023-03-06T14:15:35.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24ccb14700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c80c07c0 con 0x7f24c81507d0 2023-03-06T14:15:35.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24ccb14700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c80bfe80 con 0x7f24c806b430 2023-03-06T14:15:35.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24c659c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24c806b430 0x7f24c80bf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:35.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24c6d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24c81507d0 0x7f24c8143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:35.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24c659c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24c806b430 0x7f24c80bf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:50516/0 (socket says 172.21.15.136:50516) 2023-03-06T14:15:35.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24c659c700 1 -- 172.21.15.136:0/2201318450 learned_addr learned my addr 172.21.15.136:0/2201318450 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-06T14:15:35.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24c5d9b700 1 --2- 172.21.15.136:0/2201318450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24c8146d40 0x7f24c8145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:35.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24c6d9d700 1 -- 172.21.15.136:0/2201318450 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24c806b430 msgr2=0x7f24c80bf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24c6d9d700 1 --2- 172.21.15.136:0/2201318450 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24c806b430 0x7f24c80bf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24c6d9d700 1 -- 172.21.15.136:0/2201318450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24c8146d40 msgr2=0x7f24c8145490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24c6d9d700 1 --2- 172.21.15.136:0/2201318450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24c8146d40 0x7f24c8145490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24c6d9d700 1 -- 172.21.15.136:0/2201318450 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc0094a0 con 0x7f24c81507d0 2023-03-06T14:15:35.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24c659c700 1 --2- 172.21.15.136:0/2201318450 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24c806b430 0x7f24c80bf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:15:35.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24c6d9d700 1 --2- 172.21.15.136:0/2201318450 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24c81507d0 0x7f24c8143fc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f24c000cc40 tx=0x7f24c000cf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:35.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24b6ffd700 1 -- 172.21.15.136:0/2201318450 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c000aa20 con 0x7f24c81507d0 2023-03-06T14:15:35.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24b6ffd700 1 -- 172.21.15.136:0/2201318450 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c000aba0 con 0x7f24c81507d0 2023-03-06T14:15:35.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24ccb14700 1 -- 172.21.15.136:0/2201318450 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b8009550 con 0x7f24c81507d0 2023-03-06T14:15:35.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24b6ffd700 1 -- 172.21.15.136:0/2201318450 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c00070d0 con 0x7f24c81507d0 2023-03-06T14:15:35.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.277+0000 7f24ccb14700 1 -- 172.21.15.136:0/2201318450 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c814d880 con 0x7f24c81507d0 2023-03-06T14:15:35.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.278+0000 7f24b6ffd700 1 -- 172.21.15.136:0/2201318450 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f24c001a030 con 0x7f24c81507d0 2023-03-06T14:15:35.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.278+0000 7f24b6ffd700 1 -- 172.21.15.136:0/2201318450 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f24c001c3b0 con 0x7f24c81507d0 2023-03-06T14:15:35.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.278+0000 7f24ccb14700 1 -- 172.21.15.136:0/2201318450 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c806f4d0 con 0x7f24c81507d0 2023-03-06T14:15:35.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.281+0000 7f24b6ffd700 1 -- 172.21.15.136:0/2201318450 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f24c0018070 con 0x7f24c81507d0 2023-03-06T14:15:35.303 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:35.302+0000 7f8042485200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-06T14:15:35.314 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:35.313+0000 7f3b1cf55200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-06T14:15:35.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.365+0000 7f24ccb14700 1 -- 172.21.15.136:0/2201318450 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "aff1a438-c444-4ebc-9806-d2d117878a2c", "id": 5} v 0) v1 -- 0x7f24c806bd40 con 0x7f24c81507d0 2023-03-06T14:15:35.370 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.369+0000 7f24b6ffd700 1 -- 172.21.15.136:0/2201318450 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aff1a438-c444-4ebc-9806-d2d117878a2c", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f24c80a3260 con 0x7f24c81507d0 2023-03-06T14:15:35.370 INFO:teuthology.orchestra.run.smithi136.stdout:5 2023-03-06T14:15:35.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.370+0000 7f24ccb14700 1 -- 172.21.15.136:0/2201318450 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24c81507d0 msgr2=0x7f24c8143fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.370+0000 7f24ccb14700 1 --2- 172.21.15.136:0/2201318450 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24c81507d0 0x7f24c8143fc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f24c000cc40 tx=0x7f24c000cf50 comp rx=0 tx=0).stop 2023-03-06T14:15:35.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.370+0000 7f24ccb14700 1 -- 172.21.15.136:0/2201318450 shutdown_connections 2023-03-06T14:15:35.371 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.370+0000 7f24ccb14700 1 --2- 172.21.15.136:0/2201318450 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24c81507d0 0x7f24c8143fc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.370+0000 7f24ccb14700 1 --2- 172.21.15.136:0/2201318450 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24c806b430 0x7f24c80bf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.370+0000 7f24ccb14700 1 --2- 172.21.15.136:0/2201318450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24c8146d40 0x7f24c8145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.370+0000 7f24ccb14700 1 -- 172.21.15.136:0/2201318450 >> 172.21.15.136:0/2201318450 conn(0x7f24c80c17d0 msgr2=0x7f24c80c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:35.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.370+0000 7f24ccb14700 1 -- 172.21.15.136:0/2201318450 shutdown_connections 2023-03-06T14:15:35.372 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.370+0000 7f24ccb14700 1 -- 172.21.15.136:0/2201318450 wait complete. 2023-03-06T14:15:35.383 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 89cc219c-f57b-43f4-8e54-76017dd4930d 6 2023-03-06T14:15:35.503 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.502+0000 7f53814fd700 1 Processor -- start 2023-03-06T14:15:35.504 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.502+0000 7f53814fd700 1 -- start start 2023-03-06T14:15:35.505 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.504+0000 7f53814fd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f537c06b930 0x7f537c158970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:35.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.504+0000 7f53814fd700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537c14df60 con 0x7f537c14da60 2023-03-06T14:15:35.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.504+0000 7f53814fd700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537c06bed0 con 0x7f537c146f60 2023-03-06T14:15:35.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.504+0000 7f53814fd700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537c06c490 con 0x7f537c06b930 2023-03-06T14:15:35.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.504+0000 7f537b7fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f537c06b930 0x7f537c158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:35.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.504+0000 7f537affd700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f537c146f60 0x7f537c06e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:33832/0 (socket says 172.21.15.136:33832) 2023-03-06T14:15:35.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.504+0000 7f537affd700 1 -- 172.21.15.136:0/858693739 learned_addr learned my addr 172.21.15.136:0/858693739 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-03-06T14:15:35.506 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.504+0000 7f5379ffb700 1 -- 172.21.15.136:0/858693739 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128187642 0 0) 0x7f537c06bed0 con 0x7f537c146f60 2023-03-06T14:15:35.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.504+0000 7f5379ffb700 1 -- 172.21.15.136:0/858693739 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53640035b0 con 0x7f537c146f60 2023-03-06T14:15:35.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.504+0000 7f537b7fe700 1 -- 172.21.15.136:0/858693739 >> v1:172.21.15.136:6789/0 conn(0x7f537c146f60 legacy=0x7f537c06e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.504+0000 7f537b7fe700 1 -- 172.21.15.136:0/858693739 >> v1:172.21.15.3:6789/0 conn(0x7f537c14da60 legacy=0x7f537c06b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.504+0000 7f537b7fe700 1 -- 172.21.15.136:0/858693739 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c06c1b0 con 0x7f537c06b930 2023-03-06T14:15:35.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.504+0000 7f537b7fe700 1 --2- 172.21.15.136:0/858693739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537c06b930 0x7f537c158970 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5374009d90 tx=0x7f537400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d343d206c631591 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:35.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.504+0000 7f5379ffb700 1 -- 172.21.15.136:0/858693739 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537400e070 con 0x7f537c06b930 2023-03-06T14:15:35.507 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.504+0000 7f5379ffb700 1 -- 172.21.15.136:0/858693739 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537400bb20 con 0x7f537c06b930 2023-03-06T14:15:35.508 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.504+0000 7f5379ffb700 1 -- 172.21.15.136:0/858693739 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374012430 con 0x7f537c06b930 2023-03-06T14:15:35.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.505+0000 7f53814fd700 1 -- 172.21.15.136:0/858693739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537c06b930 msgr2=0x7f537c158970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.505+0000 7f53814fd700 1 --2- 172.21.15.136:0/858693739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537c06b930 0x7f537c158970 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5374009d90 tx=0x7f537400b330 comp rx=0 tx=0).stop 2023-03-06T14:15:35.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.505+0000 7f53814fd700 1 -- 172.21.15.136:0/858693739 shutdown_connections 2023-03-06T14:15:35.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.505+0000 7f53814fd700 1 --2- 172.21.15.136:0/858693739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537c06b930 0x7f537c158970 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.505+0000 7f53814fd700 1 -- 172.21.15.136:0/858693739 >> 172.21.15.136:0/858693739 conn(0x7f537c0c2150 msgr2=0x7f537c0c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:35.510 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.505+0000 7f53814fd700 1 -- 172.21.15.136:0/858693739 shutdown_connections 2023-03-06T14:15:35.511 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.505+0000 7f53814fd700 1 -- 172.21.15.136:0/858693739 wait complete. 2023-03-06T14:15:35.511 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.507+0000 7f53814fd700 1 Processor -- start 2023-03-06T14:15:35.511 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.507+0000 7f53814fd700 1 -- start start 2023-03-06T14:15:35.511 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.507+0000 7f53814fd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537c06b930 0x7f537c0bac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:35.511 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.507+0000 7f53814fd700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f537c146f60 0x7f537c1e5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:35.511 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.507+0000 7f53814fd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f537c14da60 0x7f537c14ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:35.511 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f53814fd700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c14a060 con 0x7f537c14da60 2023-03-06T14:15:35.512 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f53814fd700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c14a860 con 0x7f537c06b930 2023-03-06T14:15:35.512 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f53814fd700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537c1e6370 con 0x7f537c146f60 2023-03-06T14:15:35.512 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f537affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537c06b930 0x7f537c0bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:35.512 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f537affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537c06b930 0x7f537c0bac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59836/0 (socket says 172.21.15.136:59836) 2023-03-06T14:15:35.512 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f537affd700 1 -- 172.21.15.136:0/3892834071 learned_addr learned my addr 172.21.15.136:0/3892834071 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-06T14:15:35.512 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f537a7fc700 1 --2- 172.21.15.136:0/3892834071 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f537c146f60 0x7f537c1e5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:35.512 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f537b7fe700 1 --2- 172.21.15.136:0/3892834071 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f537c14da60 0x7f537c14ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:35.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f537affd700 1 -- 172.21.15.136:0/3892834071 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f537c146f60 msgr2=0x7f537c1e5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f537affd700 1 --2- 172.21.15.136:0/3892834071 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f537c146f60 0x7f537c1e5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f537affd700 1 -- 172.21.15.136:0/3892834071 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f537c14da60 msgr2=0x7f537c14ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f537affd700 1 --2- 172.21.15.136:0/3892834071 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f537c14da60 0x7f537c14ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f537affd700 1 -- 172.21.15.136:0/3892834071 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5374009a70 con 0x7f537c06b930 2023-03-06T14:15:35.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f537affd700 1 --2- 172.21.15.136:0/3892834071 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537c06b930 0x7f537c0bac60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f536c00c730 tx=0x7f536c00ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:35.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f53637fe700 1 -- 172.21.15.136:0/3892834071 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c0074e0 con 0x7f537c06b930 2023-03-06T14:15:35.513 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f53637fe700 1 -- 172.21.15.136:0/3892834071 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536c007640 con 0x7f537c06b930 2023-03-06T14:15:35.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f53814fd700 1 -- 172.21.15.136:0/3892834071 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537c06efa0 con 0x7f537c06b930 2023-03-06T14:15:35.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f53637fe700 1 -- 172.21.15.136:0/3892834071 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c005a70 con 0x7f537c06b930 2023-03-06T14:15:35.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f53814fd700 1 -- 172.21.15.136:0/3892834071 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537c06ad00 con 0x7f537c06b930 2023-03-06T14:15:35.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.508+0000 7f53637fe700 1 -- 172.21.15.136:0/3892834071 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f536c019030 con 0x7f537c06b930 2023-03-06T14:15:35.514 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.509+0000 7f53637fe700 1 -- 172.21.15.136:0/3892834071 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f536c01c440 con 0x7f537c06b930 2023-03-06T14:15:35.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.509+0000 7f53814fd700 1 -- 172.21.15.136:0/3892834071 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537c147330 con 0x7f537c06b930 2023-03-06T14:15:35.515 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.513+0000 7f53637fe700 1 -- 172.21.15.136:0/3892834071 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f536c017070 con 0x7f537c06b930 2023-03-06T14:15:35.598 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.597+0000 7f53814fd700 1 -- 172.21.15.136:0/3892834071 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "89cc219c-f57b-43f4-8e54-76017dd4930d", "id": 6} v 0) v1 -- 0x7f537c06ff90 con 0x7f537c06b930 2023-03-06T14:15:35.605 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.604+0000 7f53637fe700 1 -- 172.21.15.136:0/3892834071 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "89cc219c-f57b-43f4-8e54-76017dd4930d", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f536c005bd0 con 0x7f537c06b930 2023-03-06T14:15:35.605 INFO:teuthology.orchestra.run.smithi136.stdout:6 2023-03-06T14:15:35.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.605+0000 7f53814fd700 1 -- 172.21.15.136:0/3892834071 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537c06b930 msgr2=0x7f537c0bac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.606 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.605+0000 7f53814fd700 1 --2- 172.21.15.136:0/3892834071 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537c06b930 0x7f537c0bac60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f536c00c730 tx=0x7f536c00ca40 comp rx=0 tx=0).stop 2023-03-06T14:15:35.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.605+0000 7f53814fd700 1 -- 172.21.15.136:0/3892834071 shutdown_connections 2023-03-06T14:15:35.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.605+0000 7f53814fd700 1 --2- 172.21.15.136:0/3892834071 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f537c14da60 0x7f537c14ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.605+0000 7f53814fd700 1 --2- 172.21.15.136:0/3892834071 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537c06b930 0x7f537c0bac60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.605+0000 7f53814fd700 1 --2- 172.21.15.136:0/3892834071 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f537c146f60 0x7f537c1e5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.605+0000 7f53814fd700 1 -- 172.21.15.136:0/3892834071 >> 172.21.15.136:0/3892834071 conn(0x7f537c0c2150 msgr2=0x7f537c06e890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:35.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.605+0000 7f53814fd700 1 -- 172.21.15.136:0/3892834071 shutdown_connections 2023-03-06T14:15:35.607 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.605+0000 7f53814fd700 1 -- 172.21.15.136:0/3892834071 wait complete. 2023-03-06T14:15:35.618 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new a90e4c14-00de-4d1c-92ce-9f20df714e23 7 2023-03-06T14:15:35.751 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.750+0000 7fe00777d700 1 Processor -- start 2023-03-06T14:15:35.752 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.750+0000 7fe00777d700 1 -- start start 2023-03-06T14:15:35.753 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.751+0000 7fe00777d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe00006ea70 0x7fe0000bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:35.753 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.751+0000 7fe00777d700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe00014ff80 con 0x7fe00006ee40 2023-03-06T14:15:35.753 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.751+0000 7fe00777d700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0000bcb90 con 0x7fe0000bdd60 2023-03-06T14:15:35.753 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.751+0000 7fe00777d700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0000b9070 con 0x7fe00006ea70 2023-03-06T14:15:35.754 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.752+0000 7fe005d1a700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fe0000bdd60 0x7fe00006c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:33848/0 (socket says 172.21.15.136:33848) 2023-03-06T14:15:35.754 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.752+0000 7fe005d1a700 1 -- 172.21.15.136:0/299683214 learned_addr learned my addr 172.21.15.136:0/299683214 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-03-06T14:15:35.754 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.752+0000 7fe005519700 1 --2- 172.21.15.136:0/299683214 >> v2:172.21.15.3:3300/0 conn(0x7fe00006ea70 0x7fe0000bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:35.754 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.752+0000 7fdff7fff700 1 -- 172.21.15.136:0/299683214 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4123411461 0 0) 0x7fe0000bcb90 con 0x7fe0000bdd60 2023-03-06T14:15:35.754 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.752+0000 7fdff7fff700 1 -- 172.21.15.136:0/299683214 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfec0035b0 con 0x7fe0000bdd60 2023-03-06T14:15:35.755 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.752+0000 7fdff7fff700 1 -- 172.21.15.136:0/299683214 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188034092 0 0) 0x7fe00014ff80 con 0x7fe00006ee40 2023-03-06T14:15:35.755 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.752+0000 7fdff7fff700 1 -- 172.21.15.136:0/299683214 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0000bcb90 con 0x7fe00006ee40 2023-03-06T14:15:35.755 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.752+0000 7fe005519700 1 -- 172.21.15.136:0/299683214 >> v1:172.21.15.136:6789/0 conn(0x7fe0000bdd60 legacy=0x7fe00006c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.755 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.752+0000 7fdff7fff700 1 -- 172.21.15.136:0/299683214 <== mon.1 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3681938947 0 0) 0x7fdfec0035b0 con 0x7fe0000bdd60 2023-03-06T14:15:35.755 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.752+0000 7fe005519700 1 -- 172.21.15.136:0/299683214 >> v1:172.21.15.3:6789/0 conn(0x7fe00006ee40 legacy=0x7fe0001490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.755 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.752+0000 7fe005519700 1 -- 172.21.15.136:0/299683214 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0000bce70 con 0x7fe00006ea70 2023-03-06T14:15:35.756 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.753+0000 7fe005519700 1 --2- 172.21.15.136:0/299683214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe00006ea70 0x7fe0000bd670 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdff8009de0 tx=0x7fdff800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6caad0a8d2c19c server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:35.756 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.754+0000 7fdff7fff700 1 -- 172.21.15.136:0/299683214 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff800e070 con 0x7fe00006ea70 2023-03-06T14:15:35.756 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.754+0000 7fdff7fff700 1 -- 172.21.15.136:0/299683214 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff8003a20 con 0x7fe00006ea70 2023-03-06T14:15:35.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.754+0000 7fdff7fff700 1 -- 172.21.15.136:0/299683214 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0001670 con 0x7fe00006ea70 2023-03-06T14:15:35.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.755+0000 7fe00777d700 1 -- 172.21.15.136:0/299683214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe00006ea70 msgr2=0x7fe0000bd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.755+0000 7fe00777d700 1 --2- 172.21.15.136:0/299683214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe00006ea70 0x7fe0000bd670 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdff8009de0 tx=0x7fdff800b330 comp rx=0 tx=0).stop 2023-03-06T14:15:35.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.755+0000 7fe00777d700 1 -- 172.21.15.136:0/299683214 shutdown_connections 2023-03-06T14:15:35.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.755+0000 7fe00777d700 1 --2- 172.21.15.136:0/299683214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe00006ea70 0x7fe0000bd670 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.755+0000 7fe00777d700 1 -- 172.21.15.136:0/299683214 >> 172.21.15.136:0/299683214 conn(0x7fe0000c2150 msgr2=0x7fe0000c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:35.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.755+0000 7fe00777d700 1 -- 172.21.15.136:0/299683214 shutdown_connections 2023-03-06T14:15:35.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.755+0000 7fe00777d700 1 -- 172.21.15.136:0/299683214 wait complete. 2023-03-06T14:15:35.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.756+0000 7fe00777d700 1 Processor -- start 2023-03-06T14:15:35.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.756+0000 7fe00777d700 1 -- start start 2023-03-06T14:15:35.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.757+0000 7fe00777d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe00006ea70 0x7fe000089790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:35.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.757+0000 7fe00777d700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe00006ee40 0x7fe000146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:35.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.757+0000 7fe00777d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0000bdd60 0x7fe000142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:35.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.757+0000 7fe00777d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe000084e60 con 0x7fe00006ea70 2023-03-06T14:15:35.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.757+0000 7fe00777d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe000089cd0 con 0x7fe0000bdd60 2023-03-06T14:15:35.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.757+0000 7fe00777d700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe000085e30 con 0x7fe00006ee40 2023-03-06T14:15:35.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.758+0000 7fe005519700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe00006ea70 0x7fe000089790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:35.762 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.758+0000 7fe005519700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe00006ea70 0x7fe000089790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.136:56042/0 (socket says 172.21.15.136:56042) 2023-03-06T14:15:35.762 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.758+0000 7fe005519700 1 -- 172.21.15.136:0/486780386 learned_addr learned my addr 172.21.15.136:0/486780386 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-06T14:15:35.762 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.758+0000 7fe005d1a700 1 --2- 172.21.15.136:0/486780386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0000bdd60 0x7fe000142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:35.762 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.758+0000 7fe004d18700 1 --2- 172.21.15.136:0/486780386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe00006ee40 0x7fe000146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:35.762 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.758+0000 7fe005519700 1 -- 172.21.15.136:0/486780386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe00006ee40 msgr2=0x7fe000146df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.762 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.758+0000 7fe005519700 1 --2- 172.21.15.136:0/486780386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe00006ee40 0x7fe000146df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.762 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.758+0000 7fe005519700 1 -- 172.21.15.136:0/486780386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0000bdd60 msgr2=0x7fe000142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.758+0000 7fe005519700 1 --2- 172.21.15.136:0/486780386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0000bdd60 0x7fe000142180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.758+0000 7fe005519700 1 -- 172.21.15.136:0/486780386 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff8009a70 con 0x7fe00006ea70 2023-03-06T14:15:35.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.758+0000 7fe005d1a700 1 --2- 172.21.15.136:0/486780386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0000bdd60 0x7fe000142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:15:35.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.758+0000 7fe004d18700 1 --2- 172.21.15.136:0/486780386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe00006ee40 0x7fe000146df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:15:35.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.758+0000 7fe005519700 1 --2- 172.21.15.136:0/486780386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe00006ea70 0x7fe000089790 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdff800b370 tx=0x7fdff8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:35.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.759+0000 7fdff5ffb700 1 -- 172.21.15.136:0/486780386 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff80045c0 con 0x7fe00006ea70 2023-03-06T14:15:35.763 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.759+0000 7fdff5ffb700 1 -- 172.21.15.136:0/486780386 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff8004720 con 0x7fe00006ea70 2023-03-06T14:15:35.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.759+0000 7fe00777d700 1 -- 172.21.15.136:0/486780386 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe000150220 con 0x7fe00006ea70 2023-03-06T14:15:35.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.759+0000 7fdff5ffb700 1 -- 172.21.15.136:0/486780386 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff8012450 con 0x7fe00006ea70 2023-03-06T14:15:35.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.759+0000 7fe00777d700 1 -- 172.21.15.136:0/486780386 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0000bd150 con 0x7fe00006ea70 2023-03-06T14:15:35.764 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.760+0000 7fe00777d700 1 -- 172.21.15.136:0/486780386 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0000b8b80 con 0x7fe00006ea70 2023-03-06T14:15:35.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.768+0000 7fdff5ffb700 1 -- 172.21.15.136:0/486780386 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fdff8024030 con 0x7fe00006ea70 2023-03-06T14:15:35.769 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.768+0000 7fdff5ffb700 1 -- 172.21.15.136:0/486780386 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fdff801ea90 con 0x7fe00006ea70 2023-03-06T14:15:35.790 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.779+0000 7fdff5ffb700 1 -- 172.21.15.136:0/486780386 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fdff8022070 con 0x7fe00006ea70 2023-03-06T14:15:35.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.865+0000 7fe00777d700 1 -- 172.21.15.136:0/486780386 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a90e4c14-00de-4d1c-92ce-9f20df714e23", "id": 7} v 0) v1 -- 0x7fe0001484f0 con 0x7fe00006ea70 2023-03-06T14:15:35.869 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.868+0000 7fdff5ffb700 1 -- 172.21.15.136:0/486780386 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a90e4c14-00de-4d1c-92ce-9f20df714e23", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdff8017070 con 0x7fe00006ea70 2023-03-06T14:15:35.870 INFO:teuthology.orchestra.run.smithi136.stdout:7 2023-03-06T14:15:35.871 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.869+0000 7fe00777d700 1 -- 172.21.15.136:0/486780386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe00006ea70 msgr2=0x7fe000089790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:35.871 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.869+0000 7fe00777d700 1 --2- 172.21.15.136:0/486780386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe00006ea70 0x7fe000089790 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdff800b370 tx=0x7fdff8004ad0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.871 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.869+0000 7fe00777d700 1 -- 172.21.15.136:0/486780386 shutdown_connections 2023-03-06T14:15:35.871 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.869+0000 7fe00777d700 1 --2- 172.21.15.136:0/486780386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe00006ea70 0x7fe000089790 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.871 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.869+0000 7fe00777d700 1 --2- 172.21.15.136:0/486780386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0000bdd60 0x7fe000142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.872 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.869+0000 7fe00777d700 1 --2- 172.21.15.136:0/486780386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe00006ee40 0x7fe000146df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:35.872 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.870+0000 7fe00777d700 1 -- 172.21.15.136:0/486780386 >> 172.21.15.136:0/486780386 conn(0x7fe0000c2150 msgr2=0x7fe00006cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:35.872 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.870+0000 7fe00777d700 1 -- 172.21.15.136:0/486780386 shutdown_connections 2023-03-06T14:15:35.872 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-06T14:15:35.870+0000 7fe00777d700 1 -- 172.21.15.136:0/486780386 wait complete. 2023-03-06T14:15:35.883 INFO:tasks.ceph.osd.0:Restarting daemon 2023-03-06T14:15:35.884 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-03-06T14:15:35.886 INFO:tasks.ceph.osd.0:Started 2023-03-06T14:15:35.886 INFO:tasks.ceph.osd.1:Restarting daemon 2023-03-06T14:15:35.886 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-03-06T14:15:35.888 INFO:tasks.ceph.osd.1:Started 2023-03-06T14:15:35.888 INFO:tasks.ceph.osd.2:Restarting daemon 2023-03-06T14:15:35.889 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-03-06T14:15:35.891 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:35.890+0000 7f8042485200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-06T14:15:35.891 INFO:tasks.ceph.osd.2:Started 2023-03-06T14:15:35.891 INFO:tasks.ceph.osd.3:Restarting daemon 2023-03-06T14:15:35.892 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-03-06T14:15:35.894 INFO:tasks.ceph.osd.3:Started 2023-03-06T14:15:35.894 INFO:tasks.ceph.osd.4:Restarting daemon 2023-03-06T14:15:35.894 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-03-06T14:15:35.896 INFO:tasks.ceph.osd.4:Started 2023-03-06T14:15:35.896 INFO:tasks.ceph.osd.5:Restarting daemon 2023-03-06T14:15:35.897 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-03-06T14:15:35.898 INFO:tasks.ceph.osd.5:Started 2023-03-06T14:15:35.899 INFO:tasks.ceph.osd.6:Restarting daemon 2023-03-06T14:15:35.899 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-03-06T14:15:35.901 INFO:tasks.ceph.osd.6:Started 2023-03-06T14:15:35.901 INFO:tasks.ceph.osd.7:Restarting daemon 2023-03-06T14:15:35.901 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-03-06T14:15:35.903 INFO:tasks.ceph.osd.7:Started 2023-03-06T14:15:35.904 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T14:15:35.925 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:35.923+0000 7f3b1cf55200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-06T14:15:35.977 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:35.976+0000 7f8042485200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-06T14:15:36.020 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:36.019+0000 7f3b1cf55200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-06T14:15:36.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.064+0000 7f136f6be700 1 Processor -- start 2023-03-06T14:15:36.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.064+0000 7f136f6be700 1 -- start start 2023-03-06T14:15:36.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.065+0000 7f136f6be700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f13680c1fe0 0x7f13680c0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:36.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.065+0000 7f136f6be700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f136806fde0 0x7f13680beb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:36.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.065+0000 7f136f6be700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13680bf040 0x7f1368146950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:36.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.065+0000 7f136f6be700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13680c23b0 con 0x7f136806fde0 2023-03-06T14:15:36.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.065+0000 7f136f6be700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1368070670 con 0x7f13680c1fe0 2023-03-06T14:15:36.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.065+0000 7f136f6be700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1368151070 con 0x7f13680bf040 2023-03-06T14:15:36.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.065+0000 7f136cc59700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f136806fde0 0x7f13680beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:36.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.065+0000 7f136cc59700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f136806fde0 0x7f13680beb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55006/0 (socket says 172.21.15.3:55006) 2023-03-06T14:15:36.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.065+0000 7f136cc59700 1 -- 172.21.15.3:0/1741882755 learned_addr learned my addr 172.21.15.3:0/1741882755 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:36.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.065+0000 7f136dc5b700 1 --2- 172.21.15.3:0/1741882755 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13680bf040 0x7f1368146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:36.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.065+0000 7f136d45a700 1 --2- 172.21.15.3:0/1741882755 >> v2:172.21.15.136:3300/0 conn(0x7f13680c1fe0 0x7f13680c0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:36.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.065+0000 7f136cc59700 1 -- 172.21.15.3:0/1741882755 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13680bf040 msgr2=0x7f1368146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:36.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.065+0000 7f136cc59700 1 --2- 172.21.15.3:0/1741882755 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13680bf040 0x7f1368146950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:36.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.065+0000 7f136cc59700 1 -- 172.21.15.3:0/1741882755 >> v2:172.21.15.136:3300/0 conn(0x7f13680c1fe0 msgr2=0x7f13680c0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:36.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.065+0000 7f136cc59700 1 --2- 172.21.15.3:0/1741882755 >> v2:172.21.15.136:3300/0 conn(0x7f13680c1fe0 0x7f13680c0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:36.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.065+0000 7f136cc59700 1 -- 172.21.15.3:0/1741882755 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1368151350 con 0x7f136806fde0 2023-03-06T14:15:36.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.065+0000 7f136cc59700 1 --2- 172.21.15.3:0/1741882755 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f136806fde0 0x7f13680beb00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f13680c2530 tx=0x7f1358009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a66a7436977ab5 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:36.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.066+0000 7f135ffff700 1 -- 172.21.15.3:0/1741882755 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358011830 con 0x7f136806fde0 2023-03-06T14:15:36.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.066+0000 7f135ffff700 1 -- 172.21.15.3:0/1741882755 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1358011990 con 0x7f136806fde0 2023-03-06T14:15:36.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.066+0000 7f135ffff700 1 -- 172.21.15.3:0/1741882755 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358011d20 con 0x7f136806fde0 2023-03-06T14:15:36.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.066+0000 7f136f6be700 1 -- 172.21.15.3:0/1741882755 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f136806fde0 msgr2=0x7f13680beb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:36.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.066+0000 7f136f6be700 1 --2- 172.21.15.3:0/1741882755 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f136806fde0 0x7f13680beb00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f13680c2530 tx=0x7f1358009bd0 comp rx=0 tx=0).stop 2023-03-06T14:15:36.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.066+0000 7f136f6be700 1 -- 172.21.15.3:0/1741882755 shutdown_connections 2023-03-06T14:15:36.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.066+0000 7f136f6be700 1 --2- 172.21.15.3:0/1741882755 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13680bf040 0x7f1368146950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:36.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.066+0000 7f136f6be700 1 --2- 172.21.15.3:0/1741882755 >> v2:172.21.15.136:3300/0 conn(0x7f13680c1fe0 0x7f13680c0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:36.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.066+0000 7f136f6be700 1 --2- 172.21.15.3:0/1741882755 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f136806fde0 0x7f13680beb00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:36.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.066+0000 7f136f6be700 1 -- 172.21.15.3:0/1741882755 >> 172.21.15.3:0/1741882755 conn(0x7f13680c31d0 msgr2=0x7f13680c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:36.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.066+0000 7f136f6be700 1 -- 172.21.15.3:0/1741882755 shutdown_connections 2023-03-06T14:15:36.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.066+0000 7f136f6be700 1 -- 172.21.15.3:0/1741882755 wait complete. 2023-03-06T14:15:36.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.067+0000 7f136f6be700 1 Processor -- start 2023-03-06T14:15:36.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.067+0000 7f136f6be700 1 -- start start 2023-03-06T14:15:36.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.068+0000 7f136f6be700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f136806fde0 0x7f13680b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:36.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.068+0000 7f136f6be700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f13680bf040 0x7f13680a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:36.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.068+0000 7f136f6be700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13680c1fe0 0x7f13680a67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:36.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.068+0000 7f136f6be700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13680b8430 con 0x7f13680bf040 2023-03-06T14:15:36.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.068+0000 7f136f6be700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136806db30 con 0x7f136806fde0 2023-03-06T14:15:36.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.068+0000 7f136f6be700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136806d850 con 0x7f13680c1fe0 2023-03-06T14:15:36.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.068+0000 7f136cc59700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f13680bf040 0x7f13680a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:36.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.068+0000 7f136cc59700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f13680bf040 0x7f13680a6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55012/0 (socket says 172.21.15.3:55012) 2023-03-06T14:15:36.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.068+0000 7f136d45a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f136806fde0 0x7f13680b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:36.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.068+0000 7f136cc59700 1 -- 172.21.15.3:0/1683874562 learned_addr learned my addr 172.21.15.3:0/1683874562 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:36.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.068+0000 7f136dc5b700 1 --2- 172.21.15.3:0/1683874562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13680c1fe0 0x7f13680a67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:36.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.068+0000 7f136cc59700 1 -- 172.21.15.3:0/1683874562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13680c1fe0 msgr2=0x7f13680a67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:36.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.068+0000 7f136cc59700 1 --2- 172.21.15.3:0/1683874562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13680c1fe0 0x7f13680a67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:36.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.069+0000 7f136cc59700 1 -- 172.21.15.3:0/1683874562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f136806fde0 msgr2=0x7f13680b7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:36.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.069+0000 7f136cc59700 1 --2- 172.21.15.3:0/1683874562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f136806fde0 0x7f13680b7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:36.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.069+0000 7f136cc59700 1 -- 172.21.15.3:0/1683874562 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1358009550 con 0x7f13680bf040 2023-03-06T14:15:36.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.069+0000 7f136cc59700 1 --2- 172.21.15.3:0/1683874562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f13680bf040 0x7f13680a6290 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1358009c10 tx=0x7f1358004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:36.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.069+0000 7f135dffb700 1 -- 172.21.15.3:0/1683874562 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358004450 con 0x7f13680bf040 2023-03-06T14:15:36.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.069+0000 7f135dffb700 1 -- 172.21.15.3:0/1683874562 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135801e070 con 0x7f13680bf040 2023-03-06T14:15:36.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.069+0000 7f136f6be700 1 -- 172.21.15.3:0/1683874562 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13680bf9f0 con 0x7f13680bf040 2023-03-06T14:15:36.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.069+0000 7f135dffb700 1 -- 172.21.15.3:0/1683874562 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13580038e0 con 0x7f13680bf040 2023-03-06T14:15:36.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.069+0000 7f136f6be700 1 -- 172.21.15.3:0/1683874562 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13680c2600 con 0x7f13680bf040 2023-03-06T14:15:36.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.070+0000 7f135dffb700 1 -- 172.21.15.3:0/1683874562 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f135800f050 con 0x7f13680bf040 2023-03-06T14:15:36.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.070+0000 7f136f6be700 1 -- 172.21.15.3:0/1683874562 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13680c2b20 con 0x7f13680bf040 2023-03-06T14:15:36.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.070+0000 7f135dffb700 1 -- 172.21.15.3:0/1683874562 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f135802dcb0 con 0x7f13680bf040 2023-03-06T14:15:36.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.072+0000 7f135dffb700 1 -- 172.21.15.3:0/1683874562 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f1358020070 con 0x7f13680bf040 2023-03-06T14:15:36.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.143+0000 7f136f6be700 1 -- 172.21.15.3:0/1683874562 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13680a49d0 con 0x7f13680bf040 2023-03-06T14:15:36.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.143+0000 7f135dffb700 1 -- 172.21.15.3:0/1683874562 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f1358015020 con 0x7f13680bf040 2023-03-06T14:15:36.145 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:15:36.145 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":10,"fsid":"9aae2361-5af0-49eb-8f99-e7f69834fedf","created":"2023-03-06T14:15:33.357348+0000","modified":"2023-03-06T14:15:35.866803+0000","last_up_change":"0.000000","last_in_change":"2023-03-06T14:15:35.866803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c92c9e49-8a23-48a5-87e5-51f184f73a33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"86ec9127-843f-4246-bfbe-e14ce3af7d17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"67582de3-0f75-4cf0-84ca-e878986f99f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0fb8d708-4b38-4153-8a60-79741765d439","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"44eb9d99-975f-43a3-8bf4-213b2ba6dea5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"aff1a438-c444-4ebc-9806-d2d117878a2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"89cc219c-f57b-43f4-8e54-76017dd4930d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a90e4c14-00de-4d1c-92ce-9f20df714e23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T14:15:36.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.144+0000 7f136f6be700 1 -- 172.21.15.3:0/1683874562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f13680bf040 msgr2=0x7f13680a6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:36.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.144+0000 7f136f6be700 1 --2- 172.21.15.3:0/1683874562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f13680bf040 0x7f13680a6290 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1358009c10 tx=0x7f1358004750 comp rx=0 tx=0).stop 2023-03-06T14:15:36.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.144+0000 7f136f6be700 1 -- 172.21.15.3:0/1683874562 shutdown_connections 2023-03-06T14:15:36.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.144+0000 7f136f6be700 1 --2- 172.21.15.3:0/1683874562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13680c1fe0 0x7f13680a67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:36.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.144+0000 7f136f6be700 1 --2- 172.21.15.3:0/1683874562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f136806fde0 0x7f13680b7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:36.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.144+0000 7f136f6be700 1 --2- 172.21.15.3:0/1683874562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f13680bf040 0x7f13680a6290 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:36.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.144+0000 7f136f6be700 1 -- 172.21.15.3:0/1683874562 >> 172.21.15.3:0/1683874562 conn(0x7f13680c31d0 msgr2=0x7f136814e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:36.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.144+0000 7f136f6be700 1 -- 172.21.15.3:0/1683874562 shutdown_connections 2023-03-06T14:15:36.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:36.144+0000 7f136f6be700 1 -- 172.21.15.3:0/1683874562 wait complete. 2023-03-06T14:15:36.157 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-03-06T14:15:36.158 INFO:tasks.ceph:Waiting for OSDs to come up 2023-03-06T14:15:36.505 INFO:tasks.ceph.osd.6.smithi136.stderr:2023-03-06T14:15:36.503+0000 7fcacd612640 -1 Falling back to public interface 2023-03-06T14:15:36.505 INFO:tasks.ceph.osd.5.smithi136.stderr:2023-03-06T14:15:36.503+0000 7feb87442640 -1 Falling back to public interface 2023-03-06T14:15:36.506 INFO:tasks.ceph.osd.5.smithi136.stderr:2023-03-06T14:15:36.503+0000 7feb7e800700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2023-03-06T14:15:36.506 INFO:tasks.ceph.osd.5.smithi136.stderr:2023-03-06T14:15:36.504+0000 7feb7e800700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6806/0: (98) Address already in use 2023-03-06T14:15:36.522 INFO:tasks.ceph.osd.7.smithi136.stderr:2023-03-06T14:15:36.521+0000 7fe3aa5ea640 -1 Falling back to public interface 2023-03-06T14:15:36.523 INFO:tasks.ceph.osd.4.smithi136.stderr:2023-03-06T14:15:36.522+0000 7f8c98c2d640 -1 Falling back to public interface 2023-03-06T14:15:36.527 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-03-06T14:15:36.525+0000 7fc2768e0640 -1 Falling back to public interface 2023-03-06T14:15:36.534 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-03-06T14:15:36.532+0000 7ff1abc39640 -1 Falling back to public interface 2023-03-06T14:15:36.535 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-03-06T14:15:36.533+0000 7fa49a02e640 -1 Falling back to public interface 2023-03-06T14:15:36.539 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-03-06T14:15:36.538+0000 7f21658d6640 -1 Falling back to public interface 2023-03-06T14:15:36.668 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:36.666+0000 7f8042485200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-06T14:15:36.736 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:36.734+0000 7f3b1cf55200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-06T14:15:36.744 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:36.743+0000 7f8042485200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-06T14:15:36.817 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:36.814+0000 7f3b1cf55200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-06T14:15:36.887 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:36.886+0000 7f8042485200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-06T14:15:36.963 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:36.961+0000 7f3b1cf55200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-06T14:15:36.963 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-06T14:15:37.079 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.076+0000 7f9158f6c700 1 Processor -- start 2023-03-06T14:15:37.079 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.076+0000 7f9158f6c700 1 -- start start 2023-03-06T14:15:37.080 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.077+0000 7f9158f6c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9154071b90 0x7f91540bf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:37.080 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.077+0000 7f9158f6c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f91540bf790 0x7f9154157940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:37.081 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.077+0000 7f9158f6c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91540726a0 con 0x7f91541470f0 2023-03-06T14:15:37.081 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.077+0000 7f9158f6c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91541474c0 con 0x7f91540bf790 2023-03-06T14:15:37.081 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.077+0000 7f9158f6c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915414df20 con 0x7f9154071b90 2023-03-06T14:15:37.081 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.077+0000 7f9152d9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f91540bf790 0x7f9154157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:37.081 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.077+0000 7f915259c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f91541470f0 0x7f91541505b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57288/0 (socket says 172.21.15.3:57288) 2023-03-06T14:15:37.081 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.077+0000 7f915259c700 1 -- 172.21.15.3:0/3516338157 learned_addr learned my addr 172.21.15.3:0/3516338157 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:15:37.081 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.078+0000 7f9151d9b700 1 --2- 172.21.15.3:0/3516338157 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9154071b90 0x7f91540bf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:37.082 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.078+0000 7f9152d9d700 1 -- 172.21.15.3:0/3516338157 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9154071b90 msgr2=0x7f91540bf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:37.082 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.078+0000 7f9152d9d700 1 --2- 172.21.15.3:0/3516338157 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9154071b90 0x7f91540bf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:37.082 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.078+0000 7f9152d9d700 1 -- 172.21.15.3:0/3516338157 >> v1:172.21.15.3:6789/0 conn(0x7f91541470f0 legacy=0x7f91541505b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:37.082 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.078+0000 7f9152d9d700 1 -- 172.21.15.3:0/3516338157 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915414d160 con 0x7f91540bf790 2023-03-06T14:15:37.082 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.078+0000 7f915159a700 1 -- 172.21.15.3:0/3516338157 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378500333 0 0) 0x7f91540726a0 con 0x7f91541470f0 2023-03-06T14:15:37.082 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.078+0000 7f9151d9b700 1 --2- 172.21.15.3:0/3516338157 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9154071b90 0x7f91540bf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:15:37.082 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.078+0000 7f9152d9d700 1 --2- 172.21.15.3:0/3516338157 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91540bf790 0x7f9154157940 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f914c009d90 tx=0x7f914c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197dade32e500a10 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:37.083 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.078+0000 7f915159a700 1 -- 172.21.15.3:0/3516338157 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c00e070 con 0x7f91540bf790 2023-03-06T14:15:37.083 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.078+0000 7f915159a700 1 -- 172.21.15.3:0/3516338157 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c00bbd0 con 0x7f91540bf790 2023-03-06T14:15:37.083 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.078+0000 7f915159a700 1 -- 172.21.15.3:0/3516338157 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c012430 con 0x7f91540bf790 2023-03-06T14:15:37.085 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.079+0000 7f9158f6c700 1 -- 172.21.15.3:0/3516338157 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91540bf790 msgr2=0x7f9154157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:37.085 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.079+0000 7f9158f6c700 1 --2- 172.21.15.3:0/3516338157 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91540bf790 0x7f9154157940 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f914c009d90 tx=0x7f914c00b330 comp rx=0 tx=0).stop 2023-03-06T14:15:37.085 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.079+0000 7f9158f6c700 1 -- 172.21.15.3:0/3516338157 shutdown_connections 2023-03-06T14:15:37.085 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.079+0000 7f9158f6c700 1 --2- 172.21.15.3:0/3516338157 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91540bf790 0x7f9154157940 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:37.086 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.079+0000 7f9158f6c700 1 --2- 172.21.15.3:0/3516338157 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9154071b90 0x7f91540bf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:37.086 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.079+0000 7f9158f6c700 1 -- 172.21.15.3:0/3516338157 >> 172.21.15.3:0/3516338157 conn(0x7f91540c2d50 msgr2=0x7f91540beb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:37.086 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.079+0000 7f9158f6c700 1 -- 172.21.15.3:0/3516338157 shutdown_connections 2023-03-06T14:15:37.086 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.079+0000 7f9158f6c700 1 -- 172.21.15.3:0/3516338157 wait complete. 2023-03-06T14:15:37.086 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.080+0000 7f9158f6c700 1 Processor -- start 2023-03-06T14:15:37.086 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.080+0000 7f9158f6c700 1 -- start start 2023-03-06T14:15:37.086 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.081+0000 7f9158f6c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9154071b90 0x7f9154148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:37.087 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.081+0000 7f9158f6c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91540bf790 0x7f9154150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:37.087 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.081+0000 7f9158f6c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91541470f0 0x7f915414e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:37.087 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.081+0000 7f9158f6c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91541512b0 con 0x7f91540bf790 2023-03-06T14:15:37.087 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.081+0000 7f9158f6c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915414fdd0 con 0x7f9154071b90 2023-03-06T14:15:37.087 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.081+0000 7f9158f6c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91541500b0 con 0x7f91541470f0 2023-03-06T14:15:37.087 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.081+0000 7f9151d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91540bf790 0x7f9154150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:37.087 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.081+0000 7f9151d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91540bf790 0x7f9154150d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55024/0 (socket says 172.21.15.3:55024) 2023-03-06T14:15:37.088 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.081+0000 7f9151d9b700 1 -- 172.21.15.3:0/3720718371 learned_addr learned my addr 172.21.15.3:0/3720718371 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:37.088 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.081+0000 7f9152d9d700 1 --2- 172.21.15.3:0/3720718371 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91541470f0 0x7f915414e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:37.088 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.081+0000 7f915259c700 1 --2- 172.21.15.3:0/3720718371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9154071b90 0x7f9154148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:37.088 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.081+0000 7f9151d9b700 1 -- 172.21.15.3:0/3720718371 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91541470f0 msgr2=0x7f915414e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:37.088 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.081+0000 7f9151d9b700 1 --2- 172.21.15.3:0/3720718371 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91541470f0 0x7f915414e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:37.088 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.081+0000 7f9151d9b700 1 -- 172.21.15.3:0/3720718371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9154071b90 msgr2=0x7f9154148240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:37.088 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.081+0000 7f9151d9b700 1 --2- 172.21.15.3:0/3720718371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9154071b90 0x7f9154148240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:37.088 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.081+0000 7f9151d9b700 1 -- 172.21.15.3:0/3720718371 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c009a70 con 0x7f91540bf790 2023-03-06T14:15:37.089 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.081+0000 7f9151d9b700 1 --2- 172.21.15.3:0/3720718371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91540bf790 0x7f9154150d70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f914800e810 tx=0x7f914800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:37.089 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.082+0000 7f9142ffd700 1 -- 172.21.15.3:0/3720718371 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914800c070 con 0x7f91540bf790 2023-03-06T14:15:37.089 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.082+0000 7f9142ffd700 1 -- 172.21.15.3:0/3720718371 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9148004230 con 0x7f91540bf790 2023-03-06T14:15:37.089 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.082+0000 7f9142ffd700 1 -- 172.21.15.3:0/3720718371 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91480036a0 con 0x7f91540bf790 2023-03-06T14:15:37.089 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.082+0000 7f9158f6c700 1 -- 172.21.15.3:0/3720718371 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f915414d720 con 0x7f91540bf790 2023-03-06T14:15:37.089 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.082+0000 7f9158f6c700 1 -- 172.21.15.3:0/3720718371 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f915414d440 con 0x7f91540bf790 2023-03-06T14:15:37.089 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.082+0000 7f9142ffd700 1 -- 172.21.15.3:0/3720718371 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f9148019020 con 0x7f91540bf790 2023-03-06T14:15:37.090 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.082+0000 7f9142ffd700 1 -- 172.21.15.3:0/3720718371 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f914801c400 con 0x7f91540bf790 2023-03-06T14:15:37.090 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.083+0000 7f9158f6c700 1 -- 172.21.15.3:0/3720718371 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f915414da00 con 0x7f91540bf790 2023-03-06T14:15:37.090 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.085+0000 7f9142ffd700 1 -- 172.21.15.3:0/3720718371 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f914800f040 con 0x7f91540bf790 2023-03-06T14:15:37.160 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.157+0000 7f9158f6c700 1 -- 172.21.15.3:0/3720718371 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91541508b0 con 0x7f91540bf790 2023-03-06T14:15:37.160 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.158+0000 7f9142ffd700 1 -- 172.21.15.3:0/3720718371 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f91541508b0 con 0x7f91540bf790 2023-03-06T14:15:37.161 INFO:teuthology.misc.health.smithi003.stdout: 2023-03-06T14:15:37.161 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":10,"fsid":"9aae2361-5af0-49eb-8f99-e7f69834fedf","created":"2023-03-06T14:15:33.357348+0000","modified":"2023-03-06T14:15:35.866803+0000","last_up_change":"0.000000","last_in_change":"2023-03-06T14:15:35.866803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c92c9e49-8a23-48a5-87e5-51f184f73a33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"86ec9127-843f-4246-bfbe-e14ce3af7d17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"67582de3-0f75-4cf0-84ca-e878986f99f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0fb8d708-4b38-4153-8a60-79741765d439","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"44eb9d99-975f-43a3-8bf4-213b2ba6dea5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"aff1a438-c444-4ebc-9806-d2d117878a2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"89cc219c-f57b-43f4-8e54-76017dd4930d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a90e4c14-00de-4d1c-92ce-9f20df714e23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T14:15:37.162 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.159+0000 7f9158f6c700 1 -- 172.21.15.3:0/3720718371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91540bf790 msgr2=0x7f9154150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:37.162 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.159+0000 7f9158f6c700 1 --2- 172.21.15.3:0/3720718371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91540bf790 0x7f9154150d70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f914800e810 tx=0x7f914800eb20 comp rx=0 tx=0).stop 2023-03-06T14:15:37.162 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.159+0000 7f9158f6c700 1 -- 172.21.15.3:0/3720718371 shutdown_connections 2023-03-06T14:15:37.162 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.159+0000 7f9158f6c700 1 --2- 172.21.15.3:0/3720718371 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91541470f0 0x7f915414e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:37.162 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.159+0000 7f9158f6c700 1 --2- 172.21.15.3:0/3720718371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9154071b90 0x7f9154148240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:37.163 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.159+0000 7f9158f6c700 1 --2- 172.21.15.3:0/3720718371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91540bf790 0x7f9154150d70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:37.163 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.159+0000 7f9158f6c700 1 -- 172.21.15.3:0/3720718371 >> 172.21.15.3:0/3720718371 conn(0x7f91540c2d50 msgr2=0x7f915414c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:37.163 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.159+0000 7f9158f6c700 1 -- 172.21.15.3:0/3720718371 shutdown_connections 2023-03-06T14:15:37.163 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:37.159+0000 7f9158f6c700 1 -- 172.21.15.3:0/3720718371 wait complete. 2023-03-06T14:15:37.172 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-03-06T14:15:37.189 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:37.188+0000 7f8042485200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-06T14:15:37.276 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:37.274+0000 7f3b1cf55200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-06T14:15:37.322 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:37.321+0000 7f8042485200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-06T14:15:37.416 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:37.414+0000 7f3b1cf55200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-06T14:15:37.541 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:37.539+0000 7f8042485200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-06T14:15:37.643 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:37.640+0000 7f3b1cf55200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-06T14:15:37.698 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:37.697+0000 7f8042485200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-06T14:15:37.804 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:37.802+0000 7f3b1cf55200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-06T14:15:37.814 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:37.813+0000 7f8042485200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-06T14:15:37.924 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:37.922+0000 7f3b1cf55200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-06T14:15:38.138 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:38.137+0000 7f8042485200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-06T14:15:38.239 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:38.238+0000 7f8042485200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-06T14:15:38.255 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:38.253+0000 7f3b1cf55200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-06T14:15:38.358 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:38.356+0000 7f3b1cf55200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-06T14:15:38.422 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:38.421+0000 7f8042485200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-06T14:15:38.551 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:38.549+0000 7f3b1cf55200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-06T14:15:38.941 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:38.940+0000 7f8042485200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-06T14:15:39.110 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-03-06T14:15:39.108+0000 7f3b1cf55200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-06T14:15:39.965 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:39.964+0000 7f7ff96ee700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-03-06T14:15:39.968 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-03-06T14:15:39.967+0000 7f7ff96ee700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-03-06T14:15:40.012 INFO:tasks.ceph.osd.5.smithi136.stderr:2023-03-06T14:15:40.011+0000 7feb87442640 -1 osd.5 0 log_to_monitors true 2023-03-06T14:15:40.047 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-03-06T14:15:40.045+0000 7fc2768e0640 -1 osd.3 0 log_to_monitors true 2023-03-06T14:15:40.053 INFO:tasks.ceph.osd.6.smithi136.stderr:2023-03-06T14:15:40.052+0000 7fcacd612640 -1 osd.6 0 log_to_monitors true 2023-03-06T14:15:40.060 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-03-06T14:15:40.058+0000 7ff1abc39640 -1 osd.0 0 log_to_monitors true 2023-03-06T14:15:40.069 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-03-06T14:15:40.067+0000 7f21658d6640 -1 osd.1 0 log_to_monitors true 2023-03-06T14:15:40.072 INFO:tasks.ceph.osd.7.smithi136.stderr:2023-03-06T14:15:40.071+0000 7fe3aa5ea640 -1 osd.7 0 log_to_monitors true 2023-03-06T14:15:40.078 INFO:tasks.ceph.osd.4.smithi136.stderr:2023-03-06T14:15:40.077+0000 7f8c98c2d640 -1 osd.4 0 log_to_monitors true 2023-03-06T14:15:40.085 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-03-06T14:15:40.083+0000 7fa49a02e640 -1 osd.2 0 log_to_monitors true 2023-03-06T14:15:43.360 INFO:tasks.ceph.osd.6.smithi136.stderr:2023-03-06T14:15:43.357+0000 7fcac19ca700 -1 osd.6 0 waiting for initial osdmap 2023-03-06T14:15:43.373 INFO:tasks.ceph.osd.6.smithi136.stderr:2023-03-06T14:15:43.372+0000 7fcab95a4700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-06T14:15:43.401 INFO:tasks.ceph.osd.4.smithi136.stderr:2023-03-06T14:15:43.399+0000 7f8c8cfe5700 -1 osd.4 0 waiting for initial osdmap 2023-03-06T14:15:43.415 INFO:tasks.ceph.osd.4.smithi136.stderr:2023-03-06T14:15:43.414+0000 7f8c84bbf700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-06T14:15:43.416 INFO:tasks.ceph.osd.7.smithi136.stderr:2023-03-06T14:15:43.414+0000 7fe39e9a2700 -1 osd.7 0 waiting for initial osdmap 2023-03-06T14:15:43.427 INFO:tasks.ceph.osd.7.smithi136.stderr:2023-03-06T14:15:43.426+0000 7fe39657c700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-06T14:15:43.462 INFO:tasks.ceph.osd.5.smithi136.stderr:2023-03-06T14:15:43.461+0000 7feb7b7fa700 -1 osd.5 0 waiting for initial osdmap 2023-03-06T14:15:43.473 INFO:tasks.ceph.osd.5.smithi136.stderr:2023-03-06T14:15:43.472+0000 7feb733d4700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-06T14:15:43.939 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-03-06T14:15:43.937+0000 7f2159c8e700 -1 osd.1 0 waiting for initial osdmap 2023-03-06T14:15:43.947 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-03-06T14:15:43.943+0000 7fc26ac98700 -1 osd.3 0 waiting for initial osdmap 2023-03-06T14:15:43.953 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-03-06T14:15:43.951+0000 7f2151868700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-06T14:15:43.958 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-03-06T14:15:43.956+0000 7fa48e3e6700 -1 osd.2 0 waiting for initial osdmap 2023-03-06T14:15:43.963 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-03-06T14:15:43.961+0000 7fc262872700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-06T14:15:43.970 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-03-06T14:15:43.968+0000 7fa485fc0700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-06T14:15:43.978 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-06T14:15:44.003 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-03-06T14:15:44.001+0000 7ff19fff1700 -1 osd.0 0 waiting for initial osdmap 2023-03-06T14:15:44.019 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-03-06T14:15:44.017+0000 7ff197bcb700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-06T14:15:44.094 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.092+0000 7f30e9a42700 1 Processor -- start 2023-03-06T14:15:44.095 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.092+0000 7f30e9a42700 1 -- start start 2023-03-06T14:15:44.096 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.093+0000 7f30e9a42700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30e40bf250 0x7f30e40bf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:44.096 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.093+0000 7f30e9a42700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f30e4152f80 0x7f30e4159b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:44.096 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.093+0000 7f30e9a42700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e40be7c0 con 0x7f30e4071e40 2023-03-06T14:15:44.097 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.093+0000 7f30e9a42700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e414fca0 con 0x7f30e4152f80 2023-03-06T14:15:44.097 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.093+0000 7f30e9a42700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e40a7530 con 0x7f30e40bf250 2023-03-06T14:15:44.097 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.093+0000 7f30e37fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f30e4152f80 0x7f30e4159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:44.097 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.093+0000 7f30e37fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f30e4152f80 0x7f30e4159b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55086/0 (socket says 172.21.15.3:55086) 2023-03-06T14:15:44.097 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.093+0000 7f30e37fe700 1 -- 172.21.15.3:0/4192512658 learned_addr learned my addr 172.21.15.3:0/4192512658 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:44.097 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.093+0000 7f30e2ffd700 1 --2- 172.21.15.3:0/4192512658 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30e40bf250 0x7f30e40bf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:44.097 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.094+0000 7f30e37fe700 1 -- 172.21.15.3:0/4192512658 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30e40bf250 msgr2=0x7f30e40bf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:44.098 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.094+0000 7f30e37fe700 1 --2- 172.21.15.3:0/4192512658 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30e40bf250 0x7f30e40bf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:44.098 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.094+0000 7f30e37fe700 1 -- 172.21.15.3:0/4192512658 >> v1:172.21.15.136:6789/0 conn(0x7f30e4071e40 legacy=0x7f30e4152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:44.098 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.094+0000 7f30e37fe700 1 -- 172.21.15.3:0/4192512658 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e414ff10 con 0x7f30e4152f80 2023-03-06T14:15:44.098 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.094+0000 7f30e37fe700 1 --2- 172.21.15.3:0/4192512658 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30e4152f80 0x7f30e4159b00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009e50 tx=0x7f30dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b887300a88609f server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:44.098 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.094+0000 7f30e1ffb700 1 -- 172.21.15.3:0/4192512658 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc00e070 con 0x7f30e4152f80 2023-03-06T14:15:44.098 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.094+0000 7f30e1ffb700 1 -- 172.21.15.3:0/4192512658 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30dc00b910 con 0x7f30e4152f80 2023-03-06T14:15:44.098 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.094+0000 7f30e1ffb700 1 -- 172.21.15.3:0/4192512658 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc00bcc0 con 0x7f30e4152f80 2023-03-06T14:15:44.101 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.094+0000 7f30e9a42700 1 -- 172.21.15.3:0/4192512658 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30e4152f80 msgr2=0x7f30e4159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:44.101 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.094+0000 7f30e9a42700 1 --2- 172.21.15.3:0/4192512658 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30e4152f80 0x7f30e4159b00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009e50 tx=0x7f30dc00b330 comp rx=0 tx=0).stop 2023-03-06T14:15:44.101 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.094+0000 7f30e9a42700 1 -- 172.21.15.3:0/4192512658 shutdown_connections 2023-03-06T14:15:44.101 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.094+0000 7f30e9a42700 1 --2- 172.21.15.3:0/4192512658 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30e4152f80 0x7f30e4159b00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:44.101 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.094+0000 7f30e9a42700 1 --2- 172.21.15.3:0/4192512658 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30e40bf250 0x7f30e40bf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:44.102 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.094+0000 7f30e9a42700 1 -- 172.21.15.3:0/4192512658 >> 172.21.15.3:0/4192512658 conn(0x7f30e40c2d50 msgr2=0x7f30e40beb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:44.102 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.095+0000 7f30e9a42700 1 -- 172.21.15.3:0/4192512658 shutdown_connections 2023-03-06T14:15:44.102 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.095+0000 7f30e9a42700 1 -- 172.21.15.3:0/4192512658 wait complete. 2023-03-06T14:15:44.102 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.096+0000 7f30e9a42700 1 Processor -- start 2023-03-06T14:15:44.102 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.096+0000 7f30e9a42700 1 -- start start 2023-03-06T14:15:44.102 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.096+0000 7f30e9a42700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30e4071e40 0x7f30e41e8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:44.102 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.096+0000 7f30e9a42700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30e40bf250 0x7f30e41e4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:44.103 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.096+0000 7f30e9a42700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30e4152f80 0x7f30e41e51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:44.103 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.096+0000 7f30e9a42700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e40bc1d0 con 0x7f30e4071e40 2023-03-06T14:15:44.103 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.096+0000 7f30e9a42700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e4131f40 con 0x7f30e4152f80 2023-03-06T14:15:44.103 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.096+0000 7f30e9a42700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e40bbd40 con 0x7f30e40bf250 2023-03-06T14:15:44.103 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.096+0000 7f30e2ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30e4071e40 0x7f30e41e8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:44.103 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.097+0000 7f30e2ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30e4071e40 0x7f30e41e8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55088/0 (socket says 172.21.15.3:55088) 2023-03-06T14:15:44.103 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.097+0000 7f30e2ffd700 1 -- 172.21.15.3:0/2349207156 learned_addr learned my addr 172.21.15.3:0/2349207156 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:44.104 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.097+0000 7f30e37fe700 1 --2- 172.21.15.3:0/2349207156 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30e4152f80 0x7f30e41e51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:44.104 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.097+0000 7f30e27fc700 1 --2- 172.21.15.3:0/2349207156 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30e40bf250 0x7f30e41e4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:44.104 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.097+0000 7f30e2ffd700 1 -- 172.21.15.3:0/2349207156 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30e40bf250 msgr2=0x7f30e41e4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:44.104 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.097+0000 7f30e2ffd700 1 --2- 172.21.15.3:0/2349207156 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30e40bf250 0x7f30e41e4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:44.104 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.097+0000 7f30e2ffd700 1 -- 172.21.15.3:0/2349207156 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30e4152f80 msgr2=0x7f30e41e51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:44.104 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.097+0000 7f30e2ffd700 1 --2- 172.21.15.3:0/2349207156 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30e4152f80 0x7f30e41e51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:44.104 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.097+0000 7f30e2ffd700 1 -- 172.21.15.3:0/2349207156 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc009b30 con 0x7f30e4071e40 2023-03-06T14:15:44.104 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.097+0000 7f30e27fc700 1 --2- 172.21.15.3:0/2349207156 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30e40bf250 0x7f30e41e4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:15:44.105 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.097+0000 7f30e2ffd700 1 --2- 172.21.15.3:0/2349207156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30e4071e40 0x7f30e41e8460 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f30d800e9b0 tx=0x7f30d800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:44.105 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.097+0000 7f30cbfff700 1 -- 172.21.15.3:0/2349207156 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d8009710 con 0x7f30e4071e40 2023-03-06T14:15:44.105 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.097+0000 7f30cbfff700 1 -- 172.21.15.3:0/2349207156 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d800c850 con 0x7f30e4071e40 2023-03-06T14:15:44.105 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.097+0000 7f30e9a42700 1 -- 172.21.15.3:0/2349207156 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e4072390 con 0x7f30e4071e40 2023-03-06T14:15:44.105 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.097+0000 7f30cbfff700 1 -- 172.21.15.3:0/2349207156 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d800cbc0 con 0x7f30e4071e40 2023-03-06T14:15:44.105 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.097+0000 7f30e9a42700 1 -- 172.21.15.3:0/2349207156 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e40be450 con 0x7f30e4071e40 2023-03-06T14:15:44.105 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.098+0000 7f30e9a42700 1 -- 172.21.15.3:0/2349207156 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e4149590 con 0x7f30e4071e40 2023-03-06T14:15:44.106 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.099+0000 7f30cbfff700 1 -- 172.21.15.3:0/2349207156 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 4) v1 ==== 86375+0+0 (secure 0 0 0) 0x7f30d8019030 con 0x7f30e4071e40 2023-03-06T14:15:44.106 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.099+0000 7f30cbfff700 1 --2- 172.21.15.3:0/2349207156 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f30d00682a0 0x7f30d006a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:44.106 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.099+0000 7f30cbfff700 1 -- 172.21.15.3:0/2349207156 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f30d8084c50 con 0x7f30e4071e40 2023-03-06T14:15:44.106 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.099+0000 7f30e27fc700 1 --2- 172.21.15.3:0/2349207156 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f30d00682a0 0x7f30d006a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:44.107 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.100+0000 7f30e27fc700 1 --2- 172.21.15.3:0/2349207156 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f30d00682a0 0x7f30d006a750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f30e40b9030 tx=0x7f30d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:44.107 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.103+0000 7f30cbfff700 1 -- 172.21.15.3:0/2349207156 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f30d80523f0 con 0x7f30e4071e40 2023-03-06T14:15:44.300 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.298+0000 7f30e9a42700 1 -- 172.21.15.3:0/2349207156 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30e40b9a30 con 0x7f30e4071e40 2023-03-06T14:15:44.300 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.298+0000 7f30cbfff700 1 -- 172.21.15.3:0/2349207156 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f30e40b9a30 con 0x7f30e4071e40 2023-03-06T14:15:44.301 INFO:teuthology.misc.health.smithi003.stdout: 2023-03-06T14:15:44.301 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":12,"fsid":"9aae2361-5af0-49eb-8f99-e7f69834fedf","created":"2023-03-06T14:15:33.357348+0000","modified":"2023-03-06T14:15:41.961068+0000","last_up_change":"0.000000","last_in_change":"2023-03-06T14:15:35.866803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c92c9e49-8a23-48a5-87e5-51f184f73a33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"86ec9127-843f-4246-bfbe-e14ce3af7d17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"67582de3-0f75-4cf0-84ca-e878986f99f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0fb8d708-4b38-4153-8a60-79741765d439","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"44eb9d99-975f-43a3-8bf4-213b2ba6dea5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"aff1a438-c444-4ebc-9806-d2d117878a2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"89cc219c-f57b-43f4-8e54-76017dd4930d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a90e4c14-00de-4d1c-92ce-9f20df714e23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T14:15:44.302 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.300+0000 7f30e9a42700 1 -- 172.21.15.3:0/2349207156 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f30d00682a0 msgr2=0x7f30d006a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:44.303 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.300+0000 7f30e9a42700 1 --2- 172.21.15.3:0/2349207156 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f30d00682a0 0x7f30d006a750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f30e40b9030 tx=0x7f30d4009040 comp rx=0 tx=0).stop 2023-03-06T14:15:44.303 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.300+0000 7f30e9a42700 1 -- 172.21.15.3:0/2349207156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30e4071e40 msgr2=0x7f30e41e8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:44.303 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.300+0000 7f30e9a42700 1 --2- 172.21.15.3:0/2349207156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30e4071e40 0x7f30e41e8460 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f30d800e9b0 tx=0x7f30d800ecc0 comp rx=0 tx=0).stop 2023-03-06T14:15:44.303 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.300+0000 7f30e9a42700 1 -- 172.21.15.3:0/2349207156 shutdown_connections 2023-03-06T14:15:44.303 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.300+0000 7f30e9a42700 1 --2- 172.21.15.3:0/2349207156 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f30d00682a0 0x7f30d006a750 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:44.303 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.300+0000 7f30e9a42700 1 --2- 172.21.15.3:0/2349207156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f30e4071e40 0x7f30e41e8460 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:44.304 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.300+0000 7f30e9a42700 1 --2- 172.21.15.3:0/2349207156 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30e4152f80 0x7f30e41e51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:44.304 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.300+0000 7f30e9a42700 1 --2- 172.21.15.3:0/2349207156 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30e40bf250 0x7f30e41e4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:44.304 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.300+0000 7f30e9a42700 1 -- 172.21.15.3:0/2349207156 >> 172.21.15.3:0/2349207156 conn(0x7f30e40c2d50 msgr2=0x7f30e40bca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:44.304 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.300+0000 7f30e9a42700 1 -- 172.21.15.3:0/2349207156 shutdown_connections 2023-03-06T14:15:44.304 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:44.300+0000 7f30e9a42700 1 -- 172.21.15.3:0/2349207156 wait complete. 2023-03-06T14:15:44.313 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-03-06T14:15:51.119 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-06T14:15:51.247 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.245+0000 7fa5f161b700 1 Processor -- start 2023-03-06T14:15:51.247 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.245+0000 7fa5f161b700 1 -- start start 2023-03-06T14:15:51.249 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.245+0000 7fa5f161b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5ec149020 0x7fa5ec06c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:51.249 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.245+0000 7fa5f161b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa5ec0c3470 0x7fa5ec0c0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:51.249 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.245+0000 7fa5f161b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ec0c4d80 con 0x7fa5ec0c3000 2023-03-06T14:15:51.249 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.245+0000 7fa5f161b700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ec1493f0 con 0x7fa5ec0c3470 2023-03-06T14:15:51.250 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.245+0000 7fa5f161b700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec0c4620 con 0x7fa5ec149020 2023-03-06T14:15:51.250 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.246+0000 7fa5eb7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa5ec0c3470 0x7fa5ec0c0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:51.250 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.246+0000 7fa5ea7fc700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fa5ec0c3000 0x7fa5ec0c1c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57544/0 (socket says 172.21.15.3:57544) 2023-03-06T14:15:51.250 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.246+0000 7fa5ea7fc700 1 -- 172.21.15.3:0/1743827754 learned_addr learned my addr 172.21.15.3:0/1743827754 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:15:51.250 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.246+0000 7fa5eaffd700 1 --2- 172.21.15.3:0/1743827754 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5ec149020 0x7fa5ec06c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:51.250 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.246+0000 7fa5eb7fe700 1 -- 172.21.15.3:0/1743827754 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5ec149020 msgr2=0x7fa5ec06c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:51.250 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.246+0000 7fa5eb7fe700 1 --2- 172.21.15.3:0/1743827754 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5ec149020 0x7fa5ec06c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:51.251 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.246+0000 7fa5eb7fe700 1 -- 172.21.15.3:0/1743827754 >> v1:172.21.15.3:6789/0 conn(0x7fa5ec0c3000 legacy=0x7fa5ec0c1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:51.251 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.246+0000 7fa5e9ffb700 1 -- 172.21.15.3:0/1743827754 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153658553 0 0) 0x7fa5ec0c4d80 con 0x7fa5ec0c3000 2023-03-06T14:15:51.251 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.246+0000 7fa5eb7fe700 1 -- 172.21.15.3:0/1743827754 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec0c4aa0 con 0x7fa5ec0c3470 2023-03-06T14:15:51.251 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.246+0000 7fa5eb7fe700 1 --2- 172.21.15.3:0/1743827754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5ec0c3470 0x7fa5ec0c0b90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4009d90 tx=0x7fa5e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5366f6274bbaba11 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:51.251 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.246+0000 7fa5e9ffb700 1 -- 172.21.15.3:0/1743827754 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e400e070 con 0x7fa5ec0c3470 2023-03-06T14:15:51.251 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.246+0000 7fa5e9ffb700 1 -- 172.21.15.3:0/1743827754 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e400bbd0 con 0x7fa5ec0c3470 2023-03-06T14:15:51.251 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.246+0000 7fa5e9ffb700 1 -- 172.21.15.3:0/1743827754 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4012430 con 0x7fa5ec0c3470 2023-03-06T14:15:51.252 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.247+0000 7fa5f161b700 1 -- 172.21.15.3:0/1743827754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5ec0c3470 msgr2=0x7fa5ec0c0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:51.252 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.247+0000 7fa5f161b700 1 --2- 172.21.15.3:0/1743827754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5ec0c3470 0x7fa5ec0c0b90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4009d90 tx=0x7fa5e400b330 comp rx=0 tx=0).stop 2023-03-06T14:15:51.252 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.247+0000 7fa5f161b700 1 -- 172.21.15.3:0/1743827754 shutdown_connections 2023-03-06T14:15:51.252 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.247+0000 7fa5f161b700 1 --2- 172.21.15.3:0/1743827754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5ec0c3470 0x7fa5ec0c0b90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:51.252 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.247+0000 7fa5f161b700 1 --2- 172.21.15.3:0/1743827754 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5ec149020 0x7fa5ec06c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:51.252 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.247+0000 7fa5f161b700 1 -- 172.21.15.3:0/1743827754 >> 172.21.15.3:0/1743827754 conn(0x7fa5ec0726f0 msgr2=0x7fa5ec0a6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:51.252 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.247+0000 7fa5f161b700 1 -- 172.21.15.3:0/1743827754 shutdown_connections 2023-03-06T14:15:51.252 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.247+0000 7fa5f161b700 1 -- 172.21.15.3:0/1743827754 wait complete. 2023-03-06T14:15:51.255 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.249+0000 7fa5f161b700 1 Processor -- start 2023-03-06T14:15:51.255 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.249+0000 7fa5f161b700 1 -- start start 2023-03-06T14:15:51.255 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5f161b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5ec0c3000 0x7fa5ec0aa050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:51.255 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5f161b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5ec0c3470 0x7fa5ec1e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:51.255 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5f161b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5ec149020 0x7fa5ec0a8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:51.256 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5f161b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec0a6070 con 0x7fa5ec0c3000 2023-03-06T14:15:51.256 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5f161b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec1e8390 con 0x7fa5ec0c3470 2023-03-06T14:15:51.256 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5f161b700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec153080 con 0x7fa5ec149020 2023-03-06T14:15:51.256 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5eaffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5ec0c3000 0x7fa5ec0aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:51.256 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5eaffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5ec0c3000 0x7fa5ec0aa050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55278/0 (socket says 172.21.15.3:55278) 2023-03-06T14:15:51.256 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5eaffd700 1 -- 172.21.15.3:0/2390929373 learned_addr learned my addr 172.21.15.3:0/2390929373 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:51.256 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5eb7fe700 1 --2- 172.21.15.3:0/2390929373 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5ec149020 0x7fa5ec0a8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:51.256 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5ea7fc700 1 --2- 172.21.15.3:0/2390929373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5ec0c3470 0x7fa5ec1e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:51.257 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5eaffd700 1 -- 172.21.15.3:0/2390929373 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5ec149020 msgr2=0x7fa5ec0a8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:51.257 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5eaffd700 1 --2- 172.21.15.3:0/2390929373 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5ec149020 0x7fa5ec0a8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:51.257 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5eaffd700 1 -- 172.21.15.3:0/2390929373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5ec0c3470 msgr2=0x7fa5ec1e7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:51.257 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5eaffd700 1 --2- 172.21.15.3:0/2390929373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5ec0c3470 0x7fa5ec1e7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:51.257 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5eaffd700 1 -- 172.21.15.3:0/2390929373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e4009a70 con 0x7fa5ec0c3000 2023-03-06T14:15:51.257 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5ea7fc700 1 --2- 172.21.15.3:0/2390929373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5ec0c3470 0x7fa5ec1e7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:15:51.257 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5eaffd700 1 --2- 172.21.15.3:0/2390929373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5ec0c3000 0x7fa5ec0aa050 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00d830 tx=0x7fa5dc00dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:51.258 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5d37fe700 1 -- 172.21.15.3:0/2390929373 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc0125f0 con 0x7fa5ec0c3000 2023-03-06T14:15:51.258 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5d37fe700 1 -- 172.21.15.3:0/2390929373 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc012750 con 0x7fa5ec0c3000 2023-03-06T14:15:51.258 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5d37fe700 1 -- 172.21.15.3:0/2390929373 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc012b00 con 0x7fa5ec0c3000 2023-03-06T14:15:51.258 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5f161b700 1 -- 172.21.15.3:0/2390929373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ec14f290 con 0x7fa5ec0c3000 2023-03-06T14:15:51.258 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.250+0000 7fa5f161b700 1 -- 172.21.15.3:0/2390929373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ec14efb0 con 0x7fa5ec0c3000 2023-03-06T14:15:51.258 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.251+0000 7fa5f161b700 1 -- 172.21.15.3:0/2390929373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ec14f570 con 0x7fa5ec0c3000 2023-03-06T14:15:51.258 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.252+0000 7fa5d37fe700 1 -- 172.21.15.3:0/2390929373 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa5dc012c60 con 0x7fa5ec0c3000 2023-03-06T14:15:51.259 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.252+0000 7fa5d37fe700 1 --2- 172.21.15.3:0/2390929373 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa5d80682f0 0x7fa5d806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:51.259 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.252+0000 7fa5d37fe700 1 -- 172.21.15.3:0/2390929373 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa5dc085c60 con 0x7fa5ec0c3000 2023-03-06T14:15:51.259 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.253+0000 7fa5ea7fc700 1 --2- 172.21.15.3:0/2390929373 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa5d80682f0 0x7fa5d806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:51.259 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.253+0000 7fa5ea7fc700 1 --2- 172.21.15.3:0/2390929373 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa5d80682f0 0x7fa5d806a7a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0a82f0 tx=0x7fa5e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:51.259 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.257+0000 7fa5d37fe700 1 -- 172.21.15.3:0/2390929373 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa5dc052970 con 0x7fa5ec0c3000 2023-03-06T14:15:51.456 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.453+0000 7fa5f161b700 1 -- 172.21.15.3:0/2390929373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5ec1e8670 con 0x7fa5ec0c3000 2023-03-06T14:15:51.457 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.454+0000 7fa5d37fe700 1 -- 172.21.15.3:0/2390929373 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12334 (secure 0 0 0) 0x7fa5dc055f90 con 0x7fa5ec0c3000 2023-03-06T14:15:51.457 INFO:teuthology.misc.health.smithi003.stdout: 2023-03-06T14:15:51.457 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":16,"fsid":"9aae2361-5af0-49eb-8f99-e7f69834fedf","created":"2023-03-06T14:15:33.357348+0000","modified":"2023-03-06T14:15:47.390580+0000","last_up_change":"2023-03-06T14:15:44.374764+0000","last_in_change":"2023-03-06T14:15:35.866803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T14:15:45.023761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c92c9e49-8a23-48a5-87e5-51f184f73a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":96679},{"type":"v1","addr":"172.21.15.3:6809","nonce":96679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":96679},{"type":"v1","addr":"172.21.15.3:6811","nonce":96679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":96679},{"type":"v1","addr":"172.21.15.3:6818","nonce":96679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":96679},{"type":"v1","addr":"172.21.15.3:6814","nonce":96679}]},"public_addr":"172.21.15.3:6809/96679","cluster_addr":"172.21.15.3:6811/96679","heartbeat_back_addr":"172.21.15.3:6818/96679","heartbeat_front_addr":"172.21.15.3:6814/96679","state":["exists","up"]},{"osd":1,"uuid":"86ec9127-843f-4246-bfbe-e14ce3af7d17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":96681},{"type":"v1","addr":"172.21.15.3:6825","nonce":96681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":96681},{"type":"v1","addr":"172.21.15.3:6827","nonce":96681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":96681},{"type":"v1","addr":"172.21.15.3:6831","nonce":96681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":96681},{"type":"v1","addr":"172.21.15.3:6829","nonce":96681}]},"public_addr":"172.21.15.3:6825/96681","cluster_addr":"172.21.15.3:6827/96681","heartbeat_back_addr":"172.21.15.3:6831/96681","heartbeat_front_addr":"172.21.15.3:6829/96681","state":["exists","up"]},{"osd":2,"uuid":"67582de3-0f75-4cf0-84ca-e878986f99f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":96682},{"type":"v1","addr":"172.21.15.3:6815","nonce":96682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6817","nonce":96682},{"type":"v1","addr":"172.21.15.3:6819","nonce":96682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":96682},{"type":"v1","addr":"172.21.15.3:6823","nonce":96682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":96682},{"type":"v1","addr":"172.21.15.3:6821","nonce":96682}]},"public_addr":"172.21.15.3:6815/96682","cluster_addr":"172.21.15.3:6819/96682","heartbeat_back_addr":"172.21.15.3:6823/96682","heartbeat_front_addr":"172.21.15.3:6821/96682","state":["exists","up"]},{"osd":3,"uuid":"0fb8d708-4b38-4153-8a60-79741765d439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":96680},{"type":"v1","addr":"172.21.15.3:6801","nonce":96680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":96680},{"type":"v1","addr":"172.21.15.3:6803","nonce":96680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":96680},{"type":"v1","addr":"172.21.15.3:6807","nonce":96680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":96680},{"type":"v1","addr":"172.21.15.3:6805","nonce":96680}]},"public_addr":"172.21.15.3:6801/96680","cluster_addr":"172.21.15.3:6803/96680","heartbeat_back_addr":"172.21.15.3:6807/96680","heartbeat_front_addr":"172.21.15.3:6805/96680","state":["exists","up"]},{"osd":4,"uuid":"44eb9d99-975f-43a3-8bf4-213b2ba6dea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":96798},{"type":"v1","addr":"172.21.15.136:6822","nonce":96798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":96798},{"type":"v1","addr":"172.21.15.136:6826","nonce":96798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":96798},{"type":"v1","addr":"172.21.15.136:6831","nonce":96798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":96798},{"type":"v1","addr":"172.21.15.136:6829","nonce":96798}]},"public_addr":"172.21.15.136:6822/96798","cluster_addr":"172.21.15.136:6826/96798","heartbeat_back_addr":"172.21.15.136:6831/96798","heartbeat_front_addr":"172.21.15.136:6829/96798","state":["exists","up"]},{"osd":5,"uuid":"aff1a438-c444-4ebc-9806-d2d117878a2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":96796},{"type":"v1","addr":"172.21.15.136:6804","nonce":96796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":96796},{"type":"v1","addr":"172.21.15.136:6809","nonce":96796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":96796},{"type":"v1","addr":"172.21.15.136:6815","nonce":96796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":96796},{"type":"v1","addr":"172.21.15.136:6813","nonce":96796}]},"public_addr":"172.21.15.136:6804/96796","cluster_addr":"172.21.15.136:6809/96796","heartbeat_back_addr":"172.21.15.136:6815/96796","heartbeat_front_addr":"172.21.15.136:6813/96796","state":["exists","up"]},{"osd":6,"uuid":"89cc219c-f57b-43f4-8e54-76017dd4930d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":96797},{"type":"v1","addr":"172.21.15.136:6801","nonce":96797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6803","nonce":96797},{"type":"v1","addr":"172.21.15.136:6805","nonce":96797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":96797},{"type":"v1","addr":"172.21.15.136:6811","nonce":96797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":96797},{"type":"v1","addr":"172.21.15.136:6808","nonce":96797}]},"public_addr":"172.21.15.136:6801/96797","cluster_addr":"172.21.15.136:6805/96797","heartbeat_back_addr":"172.21.15.136:6811/96797","heartbeat_front_addr":"172.21.15.136:6808/96797","state":["exists","up"]},{"osd":7,"uuid":"a90e4c14-00de-4d1c-92ce-9f20df714e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":96819},{"type":"v1","addr":"172.21.15.136:6817","nonce":96819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":96819},{"type":"v1","addr":"172.21.15.136:6819","nonce":96819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":96819},{"type":"v1","addr":"172.21.15.136:6827","nonce":96819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":96819},{"type":"v1","addr":"172.21.15.136:6823","nonce":96819}]},"public_addr":"172.21.15.136:6817/96819","cluster_addr":"172.21.15.136:6819/96819","heartbeat_back_addr":"172.21.15.136:6827/96819","heartbeat_front_addr":"172.21.15.136:6823/96819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.093141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.034488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.128137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.097924+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.045441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.005820+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.039918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.082053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T14:15:51.458 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.456+0000 7fa5f161b700 1 -- 172.21.15.3:0/2390929373 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa5d80682f0 msgr2=0x7fa5d806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:51.459 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.456+0000 7fa5f161b700 1 --2- 172.21.15.3:0/2390929373 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa5d80682f0 0x7fa5d806a7a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0a82f0 tx=0x7fa5e0009040 comp rx=0 tx=0).stop 2023-03-06T14:15:51.459 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.456+0000 7fa5f161b700 1 -- 172.21.15.3:0/2390929373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5ec0c3000 msgr2=0x7fa5ec0aa050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:51.459 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.456+0000 7fa5f161b700 1 --2- 172.21.15.3:0/2390929373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5ec0c3000 0x7fa5ec0aa050 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00d830 tx=0x7fa5dc00dbf0 comp rx=0 tx=0).stop 2023-03-06T14:15:51.459 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.456+0000 7fa5f161b700 1 -- 172.21.15.3:0/2390929373 shutdown_connections 2023-03-06T14:15:51.459 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.456+0000 7fa5f161b700 1 --2- 172.21.15.3:0/2390929373 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa5d80682f0 0x7fa5d806a7a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:51.459 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.456+0000 7fa5f161b700 1 --2- 172.21.15.3:0/2390929373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5ec0c3000 0x7fa5ec0aa050 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:51.460 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.456+0000 7fa5f161b700 1 --2- 172.21.15.3:0/2390929373 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5ec149020 0x7fa5ec0a8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:51.460 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.456+0000 7fa5f161b700 1 --2- 172.21.15.3:0/2390929373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5ec0c3470 0x7fa5ec1e7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:51.460 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.456+0000 7fa5f161b700 1 -- 172.21.15.3:0/2390929373 >> 172.21.15.3:0/2390929373 conn(0x7fa5ec0726f0 msgr2=0x7fa5ec1db3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:51.460 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.456+0000 7fa5f161b700 1 -- 172.21.15.3:0/2390929373 shutdown_connections 2023-03-06T14:15:51.460 INFO:teuthology.misc.health.smithi003.stderr:2023-03-06T14:15:51.456+0000 7fa5f161b700 1 -- 172.21.15.3:0/2390929373 wait complete. 2023-03-06T14:15:51.469 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-03-06T14:15:51.470 INFO:tasks.ceph:Creating RBD pool 2023-03-06T14:15:51.470 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd pool create rbd 8 2023-03-06T14:15:51.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.591+0000 7f8059d42700 1 Processor -- start 2023-03-06T14:15:51.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.591+0000 7f8059d42700 1 -- start start 2023-03-06T14:15:51.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.592+0000 7f8059d42700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f805406ee40 0x7f80540bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:51.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.592+0000 7f8059d42700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f80540bdd60 0x7f805406c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:51.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.592+0000 7f8059d42700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f805414ff80 con 0x7f805406ea70 2023-03-06T14:15:51.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.592+0000 7f8059d42700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80540b9070 con 0x7f80540bdd60 2023-03-06T14:15:51.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.592+0000 7f8059d42700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80540bcb90 con 0x7f805406ee40 2023-03-06T14:15:51.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.592+0000 7f8052ffd700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f805406ee40 0x7f80540bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:51.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.592+0000 7f8053fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f80540bdd60 0x7f805406c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:51.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.592+0000 7f80537fe700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f805406ea70 0x7f80541490f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.3:55044/0 (socket says 172.21.15.3:55044) 2023-03-06T14:15:51.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.592+0000 7f8053fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f80540bdd60 0x7f805406c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.3:41380/0 (socket says 172.21.15.3:41380) 2023-03-06T14:15:51.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.592+0000 7f80537fe700 1 -- 172.21.15.3:0/3252788827 learned_addr learned my addr 172.21.15.3:0/3252788827 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:15:51.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.592+0000 7f8052ffd700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f805406ee40 0x7f80540bd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.3:48268/0 (socket says 172.21.15.3:48268) 2023-03-06T14:15:51.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.592+0000 7f80527fc700 1 -- 172.21.15.3:0/3252788827 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830877896 0 0) 0x7f805414ff80 con 0x7f805406ea70 2023-03-06T14:15:51.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.592+0000 7f80527fc700 1 -- 172.21.15.3:0/3252788827 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f803c0035b0 con 0x7f805406ea70 2023-03-06T14:15:51.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.592+0000 7f8053fff700 1 -- 172.21.15.3:0/3252788827 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f805406ee40 msgr2=0x7f80540bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:51.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.592+0000 7f8053fff700 1 --2- 172.21.15.3:0/3252788827 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f805406ee40 0x7f80540bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:51.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.592+0000 7f8053fff700 1 -- 172.21.15.3:0/3252788827 >> v1:172.21.15.136:6789/0 conn(0x7f805406ea70 legacy=0x7f80541490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:51.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.592+0000 7f8053fff700 1 -- 172.21.15.3:0/3252788827 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80540bce70 con 0x7f80540bdd60 2023-03-06T14:15:51.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.592+0000 7f8052ffd700 1 --2- 172.21.15.3:0/3252788827 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f805406ee40 0x7f80540bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:15:51.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.593+0000 7f8053fff700 1 --2- 172.21.15.3:0/3252788827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80540bdd60 0x7f805406c8a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f804c009d90 tx=0x7f804c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75d306ae8b6cfb0b server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:51.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.593+0000 7f80527fc700 1 -- 172.21.15.3:0/3252788827 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c00e070 con 0x7f80540bdd60 2023-03-06T14:15:51.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.593+0000 7f80527fc700 1 -- 172.21.15.3:0/3252788827 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804c00bb20 con 0x7f80540bdd60 2023-03-06T14:15:51.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.593+0000 7f80527fc700 1 -- 172.21.15.3:0/3252788827 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c00be90 con 0x7f80540bdd60 2023-03-06T14:15:51.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.593+0000 7f8059d42700 1 -- 172.21.15.3:0/3252788827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80540bdd60 msgr2=0x7f805406c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:51.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.593+0000 7f8059d42700 1 --2- 172.21.15.3:0/3252788827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80540bdd60 0x7f805406c8a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f804c009d90 tx=0x7f804c00b330 comp rx=0 tx=0).stop 2023-03-06T14:15:51.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.593+0000 7f8059d42700 1 -- 172.21.15.3:0/3252788827 shutdown_connections 2023-03-06T14:15:51.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.593+0000 7f8059d42700 1 --2- 172.21.15.3:0/3252788827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80540bdd60 0x7f805406c8a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:51.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.593+0000 7f8059d42700 1 --2- 172.21.15.3:0/3252788827 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f805406ee40 0x7f80540bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:51.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.593+0000 7f8059d42700 1 -- 172.21.15.3:0/3252788827 >> 172.21.15.3:0/3252788827 conn(0x7f80540c2150 msgr2=0x7f80540c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:51.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.593+0000 7f8059d42700 1 -- 172.21.15.3:0/3252788827 shutdown_connections 2023-03-06T14:15:51.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.593+0000 7f8059d42700 1 -- 172.21.15.3:0/3252788827 wait complete. 2023-03-06T14:15:51.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.595+0000 7f8059d42700 1 Processor -- start 2023-03-06T14:15:51.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.595+0000 7f8059d42700 1 -- start start 2023-03-06T14:15:51.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.595+0000 7f8059d42700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f805406ea70 0x7f805414ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:51.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.595+0000 7f8059d42700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f805406ee40 0x7f8054150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:51.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.595+0000 7f8059d42700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80540bdd60 0x7f8054148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:51.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.595+0000 7f8059d42700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80541e7840 con 0x7f80540bdd60 2023-03-06T14:15:51.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.595+0000 7f8059d42700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80540a7b00 con 0x7f805406ee40 2023-03-06T14:15:51.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.595+0000 7f8059d42700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80541e83c0 con 0x7f805406ea70 2023-03-06T14:15:51.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.596+0000 7f8053fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80540bdd60 0x7f8054148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:51.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.596+0000 7f8053fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80540bdd60 0x7f8054148130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55296/0 (socket says 172.21.15.3:55296) 2023-03-06T14:15:51.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.596+0000 7f8053fff700 1 -- 172.21.15.3:0/716455561 learned_addr learned my addr 172.21.15.3:0/716455561 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:51.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.596+0000 7f80537fe700 1 --2- 172.21.15.3:0/716455561 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f805406ea70 0x7f805414ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:51.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.596+0000 7f8052ffd700 1 --2- 172.21.15.3:0/716455561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f805406ee40 0x7f8054150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:51.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.596+0000 7f8053fff700 1 -- 172.21.15.3:0/716455561 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f805406ea70 msgr2=0x7f805414ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:51.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.596+0000 7f8053fff700 1 --2- 172.21.15.3:0/716455561 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f805406ea70 0x7f805414ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:51.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.596+0000 7f8053fff700 1 -- 172.21.15.3:0/716455561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f805406ee40 msgr2=0x7f8054150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:51.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.596+0000 7f8053fff700 1 --2- 172.21.15.3:0/716455561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f805406ee40 0x7f8054150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:51.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.596+0000 7f8053fff700 1 -- 172.21.15.3:0/716455561 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80440094a0 con 0x7f80540bdd60 2023-03-06T14:15:51.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.596+0000 7f8053fff700 1 --2- 172.21.15.3:0/716455561 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80540bdd60 0x7f8054148130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f80540c2eb0 tx=0x7f804c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:51.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.596+0000 7f803bfff700 1 -- 172.21.15.3:0/716455561 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c004800 con 0x7f80540bdd60 2023-03-06T14:15:51.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.596+0000 7f803bfff700 1 -- 172.21.15.3:0/716455561 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804c020070 con 0x7f80540bdd60 2023-03-06T14:15:51.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.596+0000 7f8059d42700 1 -- 172.21.15.3:0/716455561 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804c009a70 con 0x7f80540bdd60 2023-03-06T14:15:51.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.596+0000 7f803bfff700 1 -- 172.21.15.3:0/716455561 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c0276c0 con 0x7f80540bdd60 2023-03-06T14:15:51.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.596+0000 7f8059d42700 1 -- 172.21.15.3:0/716455561 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8054150220 con 0x7f80540bdd60 2023-03-06T14:15:51.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.597+0000 7f8059d42700 1 -- 172.21.15.3:0/716455561 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80540bd150 con 0x7f80540bdd60 2023-03-06T14:15:51.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.598+0000 7f803bfff700 1 -- 172.21.15.3:0/716455561 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f804c012430 con 0x7f80540bdd60 2023-03-06T14:15:51.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.598+0000 7f803bfff700 1 --2- 172.21.15.3:0/716455561 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f80400682f0 0x7f804006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:51.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.598+0000 7f803bfff700 1 -- 172.21.15.3:0/716455561 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f804c022070 con 0x7f80540bdd60 2023-03-06T14:15:51.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.598+0000 7f80537fe700 1 --2- 172.21.15.3:0/716455561 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f80400682f0 0x7f804006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:51.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.599+0000 7f80537fe700 1 --2- 172.21.15.3:0/716455561 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f80400682f0 0x7f804006a7a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8048005960 tx=0x7f8048009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:51.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.602+0000 7f803bfff700 1 -- 172.21.15.3:0/716455561 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f804c054440 con 0x7f80540bdd60 2023-03-06T14:15:51.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:51.799+0000 7f8059d42700 1 -- 172.21.15.3:0/716455561 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f80540b8b80 con 0x7f80540bdd60 2023-03-06T14:15:52.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.020+0000 7f803bfff700 1 -- 172.21.15.3:0/716455561 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f804c057a60 con 0x7f80540bdd60 2023-03-06T14:15:52.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.023+0000 7f8059d42700 1 -- 172.21.15.3:0/716455561 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f80400682f0 msgr2=0x7f804006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:52.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.023+0000 7f8059d42700 1 --2- 172.21.15.3:0/716455561 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f80400682f0 0x7f804006a7a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8048005960 tx=0x7f8048009040 comp rx=0 tx=0).stop 2023-03-06T14:15:52.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.023+0000 7f8059d42700 1 -- 172.21.15.3:0/716455561 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80540bdd60 msgr2=0x7f8054148130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:52.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.023+0000 7f8059d42700 1 --2- 172.21.15.3:0/716455561 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80540bdd60 0x7f8054148130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f80540c2eb0 tx=0x7f804c004ad0 comp rx=0 tx=0).stop 2023-03-06T14:15:52.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.023+0000 7f8059d42700 1 -- 172.21.15.3:0/716455561 shutdown_connections 2023-03-06T14:15:52.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.023+0000 7f8059d42700 1 --2- 172.21.15.3:0/716455561 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f80400682f0 0x7f804006a7a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:52.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.023+0000 7f8059d42700 1 --2- 172.21.15.3:0/716455561 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80540bdd60 0x7f8054148130 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:52.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.023+0000 7f8059d42700 1 --2- 172.21.15.3:0/716455561 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f805406ea70 0x7f805414ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:52.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.023+0000 7f8059d42700 1 --2- 172.21.15.3:0/716455561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f805406ee40 0x7f8054150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:52.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.023+0000 7f8059d42700 1 -- 172.21.15.3:0/716455561 >> 172.21.15.3:0/716455561 conn(0x7f80540c2150 msgr2=0x7f805414b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:52.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.024+0000 7f8059d42700 1 -- 172.21.15.3:0/716455561 shutdown_connections 2023-03-06T14:15:52.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.024+0000 7f8059d42700 1 -- 172.21.15.3:0/716455561 wait complete. 2023-03-06T14:15:52.030 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'rbd' created 2023-03-06T14:15:52.038 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-03-06T14:15:52.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.161+0000 7fc50a47d700 1 Processor -- start 2023-03-06T14:15:52.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.161+0000 7fc50a47d700 1 -- start start 2023-03-06T14:15:52.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.162+0000 7fc50a47d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc5040702f0 0x7fc5040a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:52.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.162+0000 7fc50a47d700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc50414df00 con 0x7fc5040c23e0 2023-03-06T14:15:52.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.162+0000 7fc50a47d700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc50406a4e0 con 0x7fc50414da00 2023-03-06T14:15:52.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.162+0000 7fc50a47d700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc50414aaa0 con 0x7fc5040702f0 2023-03-06T14:15:52.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.162+0000 7fc503fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fc5040c23e0 0x7fc5040be880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57572/0 (socket says 172.21.15.3:57572) 2023-03-06T14:15:52.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.162+0000 7fc503fff700 1 -- 172.21.15.3:0/1250905270 learned_addr learned my addr 172.21.15.3:0/1250905270 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:15:52.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.162+0000 7fc508a1a700 1 --2- 172.21.15.3:0/1250905270 >> v2:172.21.15.136:3300/0 conn(0x7fc5040702f0 0x7fc5040a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:52.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.162+0000 7fc502ffd700 1 -- 172.21.15.3:0/1250905270 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567640241 0 0) 0x7fc50414df00 con 0x7fc5040c23e0 2023-03-06T14:15:52.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.162+0000 7fc502ffd700 1 -- 172.21.15.3:0/1250905270 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4f00035b0 con 0x7fc5040c23e0 2023-03-06T14:15:52.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc502ffd700 1 -- 172.21.15.3:0/1250905270 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3374692115 0 0) 0x7fc4f00035b0 con 0x7fc5040c23e0 2023-03-06T14:15:52.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc502ffd700 1 -- 172.21.15.3:0/1250905270 >> v2:172.21.15.136:3300/0 conn(0x7fc5040702f0 msgr2=0x7fc5040a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:52.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc502ffd700 1 --2- 172.21.15.3:0/1250905270 >> v2:172.21.15.136:3300/0 conn(0x7fc5040702f0 0x7fc5040a1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:52.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc502ffd700 1 -- 172.21.15.3:0/1250905270 >> v1:172.21.15.136:6789/0 conn(0x7fc50414da00 legacy=0x7fc50406a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:52.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc502ffd700 1 -- 172.21.15.3:0/1250905270 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5040be3f0 con 0x7fc5040c23e0 2023-03-06T14:15:52.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc502ffd700 1 -- 172.21.15.3:0/1250905270 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3255535284 0 0) 0x7fc4f4001670 con 0x7fc5040c23e0 2023-03-06T14:15:52.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc502ffd700 1 -- 172.21.15.3:0/1250905270 >> v1:172.21.15.3:6789/0 conn(0x7fc5040c23e0 legacy=0x7fc5040be880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:52.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc502ffd700 1 --2- 172.21.15.3:0/1250905270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4f0003a00 0x7fc4f0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:52.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc502ffd700 1 --2- 172.21.15.3:0/1250905270 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4f0004850 0x7fc4f0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:52.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc502ffd700 1 --2- 172.21.15.3:0/1250905270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc4f0005320 0x7fc4f000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:52.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc502ffd700 1 -- 172.21.15.3:0/1250905270 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50414aaa0 con 0x7fc4f0004850 2023-03-06T14:15:52.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc502ffd700 1 -- 172.21.15.3:0/1250905270 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f000c250 con 0x7fc4f0003a00 2023-03-06T14:15:52.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc502ffd700 1 -- 172.21.15.3:0/1250905270 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f000c410 con 0x7fc4f0005320 2023-03-06T14:15:52.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc5037fe700 1 --2- 172.21.15.3:0/1250905270 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4f0004850 0x7fc4f0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:52.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc503fff700 1 --2- 172.21.15.3:0/1250905270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4f0003a00 0x7fc4f0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:52.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc508a1a700 1 --2- 172.21.15.3:0/1250905270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc4f0005320 0x7fc4f000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:52.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc5037fe700 1 -- 172.21.15.3:0/1250905270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc4f0005320 msgr2=0x7fc4f000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:52.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc5037fe700 1 --2- 172.21.15.3:0/1250905270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc4f0005320 0x7fc4f000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:52.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc5037fe700 1 -- 172.21.15.3:0/1250905270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4f0003a00 msgr2=0x7fc4f0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:52.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc5037fe700 1 --2- 172.21.15.3:0/1250905270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4f0003a00 0x7fc4f0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:52.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc5037fe700 1 -- 172.21.15.3:0/1250905270 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f00035b0 con 0x7fc4f0004850 2023-03-06T14:15:52.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc508a1a700 1 -- 172.21.15.3:0/1250905270 reap_dead start 2023-03-06T14:15:52.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc5037fe700 1 --2- 172.21.15.3:0/1250905270 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4f0004850 0x7fc4f0004cc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0017c0 tx=0x7fc4f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6e0afadd71612f server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:52.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.163+0000 7fc502ffd700 1 -- 172.21.15.3:0/1250905270 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0052d0 con 0x7fc4f0004850 2023-03-06T14:15:52.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.164+0000 7fc502ffd700 1 -- 172.21.15.3:0/1250905270 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec005430 con 0x7fc4f0004850 2023-03-06T14:15:52.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.164+0000 7fc502ffd700 1 -- 172.21.15.3:0/1250905270 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0038c0 con 0x7fc4f0004850 2023-03-06T14:15:52.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.164+0000 7fc50a47d700 1 -- 172.21.15.3:0/1250905270 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4f0004850 msgr2=0x7fc4f0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:52.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.164+0000 7fc50a47d700 1 --2- 172.21.15.3:0/1250905270 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4f0004850 0x7fc4f0004cc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0017c0 tx=0x7fc4f0005880 comp rx=0 tx=0).stop 2023-03-06T14:15:52.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.164+0000 7fc50a47d700 1 -- 172.21.15.3:0/1250905270 shutdown_connections 2023-03-06T14:15:52.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.164+0000 7fc50a47d700 1 --2- 172.21.15.3:0/1250905270 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4f0004850 0x7fc4f0004cc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:52.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.164+0000 7fc50a47d700 1 -- 172.21.15.3:0/1250905270 >> 172.21.15.3:0/1250905270 conn(0x7fc5040c30c0 msgr2=0x7fc5040c34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:52.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.164+0000 7fc50a47d700 1 -- 172.21.15.3:0/1250905270 shutdown_connections 2023-03-06T14:15:52.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.164+0000 7fc50a47d700 1 -- 172.21.15.3:0/1250905270 wait complete. 2023-03-06T14:15:52.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.165+0000 7fc50a47d700 1 Processor -- start 2023-03-06T14:15:52.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.165+0000 7fc50a47d700 1 -- start start 2023-03-06T14:15:52.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.166+0000 7fc50a47d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4f0004850 0x7fc5041d8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:52.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.166+0000 7fc50a47d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5040ba610 0x7fc5040b8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:52.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.166+0000 7fc50a47d700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5040b8760 0x7fc5041e5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:52.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.166+0000 7fc50a47d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5040a62f0 con 0x7fc5040ba610 2023-03-06T14:15:52.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.166+0000 7fc50a47d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5040a6e40 con 0x7fc4f0004850 2023-03-06T14:15:52.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.166+0000 7fc50a47d700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5040baa80 con 0x7fc5040b8760 2023-03-06T14:15:52.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.166+0000 7fc5037fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5040ba610 0x7fc5040b8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:52.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.166+0000 7fc5037fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5040ba610 0x7fc5040b8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55314/0 (socket says 172.21.15.3:55314) 2023-03-06T14:15:52.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.166+0000 7fc5037fe700 1 -- 172.21.15.3:0/2662311069 learned_addr learned my addr 172.21.15.3:0/2662311069 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:52.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.166+0000 7fc503fff700 1 --2- 172.21.15.3:0/2662311069 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4f0004850 0x7fc5041d8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:52.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.166+0000 7fc508a1a700 1 --2- 172.21.15.3:0/2662311069 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5040b8760 0x7fc5041e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:52.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.166+0000 7fc5037fe700 1 -- 172.21.15.3:0/2662311069 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5040b8760 msgr2=0x7fc5041e5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:52.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.166+0000 7fc5037fe700 1 --2- 172.21.15.3:0/2662311069 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5040b8760 0x7fc5041e5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:52.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.166+0000 7fc5037fe700 1 -- 172.21.15.3:0/2662311069 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4f0004850 msgr2=0x7fc5041d8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:52.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.166+0000 7fc5037fe700 1 --2- 172.21.15.3:0/2662311069 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4f0004850 0x7fc5041d8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:52.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.166+0000 7fc5037fe700 1 -- 172.21.15.3:0/2662311069 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc504070ef0 con 0x7fc5040ba610 2023-03-06T14:15:52.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.167+0000 7fc5037fe700 1 --2- 172.21.15.3:0/2662311069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5040ba610 0x7fc5040b8220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000c220 tx=0x7fc4ec001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:52.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.167+0000 7fc500ff9700 1 -- 172.21.15.3:0/2662311069 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec001290 con 0x7fc5040ba610 2023-03-06T14:15:52.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.167+0000 7fc500ff9700 1 -- 172.21.15.3:0/2662311069 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec007040 con 0x7fc5040ba610 2023-03-06T14:15:52.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.167+0000 7fc500ff9700 1 -- 172.21.15.3:0/2662311069 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0073f0 con 0x7fc5040ba610 2023-03-06T14:15:52.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.167+0000 7fc50a47d700 1 -- 172.21.15.3:0/2662311069 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc504070c10 con 0x7fc5040ba610 2023-03-06T14:15:52.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.167+0000 7fc50a47d700 1 -- 172.21.15.3:0/2662311069 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc50406fe70 con 0x7fc5040ba610 2023-03-06T14:15:52.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.168+0000 7fc50a47d700 1 -- 172.21.15.3:0/2662311069 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc504067670 con 0x7fc5040ba610 2023-03-06T14:15:52.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.168+0000 7fc500ff9700 1 -- 172.21.15.3:0/2662311069 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc4ec02d070 con 0x7fc5040ba610 2023-03-06T14:15:52.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.169+0000 7fc500ff9700 1 --2- 172.21.15.3:0/2662311069 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc4e40682f0 0x7fc4e406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:52.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.169+0000 7fc500ff9700 1 -- 172.21.15.3:0/2662311069 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fc4ec086180 con 0x7fc5040ba610 2023-03-06T14:15:52.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.169+0000 7fc503fff700 1 --2- 172.21.15.3:0/2662311069 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc4e40682f0 0x7fc4e406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:52.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.169+0000 7fc503fff700 1 --2- 172.21.15.3:0/2662311069 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc4e40682f0 0x7fc4e406a7a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4000ff0 tx=0x7fc4f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:52.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.173+0000 7fc500ff9700 1 -- 172.21.15.3:0/2662311069 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc4ec052d40 con 0x7fc5040ba610 2023-03-06T14:15:52.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:52.367+0000 7fc50a47d700 1 -- 172.21.15.3:0/2662311069 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc50406ba30 con 0x7fc5040ba610 2023-03-06T14:15:53.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.030+0000 7fc500ff9700 1 -- 172.21.15.3:0/2662311069 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc4ec056360 con 0x7fc5040ba610 2023-03-06T14:15:53.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.034+0000 7fc50a47d700 1 -- 172.21.15.3:0/2662311069 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc4e40682f0 msgr2=0x7fc4e406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:53.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.035+0000 7fc50a47d700 1 --2- 172.21.15.3:0/2662311069 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc4e40682f0 0x7fc4e406a7a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4000ff0 tx=0x7fc4f4009040 comp rx=0 tx=0).stop 2023-03-06T14:15:53.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.035+0000 7fc50a47d700 1 -- 172.21.15.3:0/2662311069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5040ba610 msgr2=0x7fc5040b8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:53.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.035+0000 7fc50a47d700 1 --2- 172.21.15.3:0/2662311069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5040ba610 0x7fc5040b8220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000c220 tx=0x7fc4ec001120 comp rx=0 tx=0).stop 2023-03-06T14:15:53.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.035+0000 7fc50a47d700 1 -- 172.21.15.3:0/2662311069 shutdown_connections 2023-03-06T14:15:53.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.035+0000 7fc50a47d700 1 --2- 172.21.15.3:0/2662311069 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc4e40682f0 0x7fc4e406a7a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.035+0000 7fc50a47d700 1 --2- 172.21.15.3:0/2662311069 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5040b8760 0x7fc5041e5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.035+0000 7fc50a47d700 1 --2- 172.21.15.3:0/2662311069 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4f0004850 0x7fc5041d8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.035+0000 7fc50a47d700 1 --2- 172.21.15.3:0/2662311069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5040ba610 0x7fc5040b8220 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.035+0000 7fc50a47d700 1 -- 172.21.15.3:0/2662311069 >> 172.21.15.3:0/2662311069 conn(0x7fc5040c30c0 msgr2=0x7fc5040a2020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:53.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.035+0000 7fc50a47d700 1 -- 172.21.15.3:0/2662311069 shutdown_connections 2023-03-06T14:15:53.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.035+0000 7fc50a47d700 1 -- 172.21.15.3:0/2662311069 wait complete. 2023-03-06T14:15:53.040 INFO:teuthology.orchestra.run.smithi003.stderr:enabled application 'rbd' on pool 'rbd' 2023-03-06T14:15:53.052 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-03-06T14:15:53.053 INFO:tasks.ceph.mds.a:Restarting daemon 2023-03-06T14:15:53.053 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-03-06T14:15:53.055 INFO:tasks.ceph.mds.a:Started 2023-03-06T14:15:53.056 INFO:tasks.ceph.mds.c:Restarting daemon 2023-03-06T14:15:53.056 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-03-06T14:15:53.058 INFO:tasks.ceph.mds.c:Started 2023-03-06T14:15:53.058 INFO:tasks.ceph.mds.b:Restarting daemon 2023-03-06T14:15:53.058 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-03-06T14:15:53.061 INFO:tasks.ceph.mds.b:Started 2023-03-06T14:15:53.061 INFO:tasks.ceph.mds.d:Restarting daemon 2023-03-06T14:15:53.061 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-03-06T14:15:53.063 INFO:tasks.ceph.mds.d:Started 2023-03-06T14:15:53.063 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-03-06T14:15:53.064 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T14:15:53.146 INFO:tasks.ceph.mds.b.smithi136.stdout:starting mds.b at 2023-03-06T14:15:53.147 INFO:tasks.ceph.mds.c.smithi003.stdout:starting mds.c at 2023-03-06T14:15:53.147 INFO:tasks.ceph.mds.d.smithi136.stdout:starting mds.d at 2023-03-06T14:15:53.147 INFO:tasks.ceph.mds.a.smithi003.stdout:starting mds.a at 2023-03-06T14:15:53.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.201+0000 7f63e52f6700 1 Processor -- start 2023-03-06T14:15:53.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.201+0000 7f63e52f6700 1 -- start start 2023-03-06T14:15:53.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.202+0000 7f63e52f6700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63e006ee40 0x7f63e00bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:53.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.202+0000 7f63e52f6700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f63e00bdd60 0x7f63e006c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:53.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.202+0000 7f63e52f6700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e014ff80 con 0x7f63e006ea70 2023-03-06T14:15:53.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.202+0000 7f63e52f6700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e00b9070 con 0x7f63e00bdd60 2023-03-06T14:15:53.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.202+0000 7f63e52f6700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00bcb90 con 0x7f63e006ee40 2023-03-06T14:15:53.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.202+0000 7f63deffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f63e006ea70 0x7f63e01490f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57616/0 (socket says 172.21.15.3:57616) 2023-03-06T14:15:53.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.202+0000 7f63deffd700 1 -- 172.21.15.3:0/1340148340 learned_addr learned my addr 172.21.15.3:0/1340148340 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:15:53.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.202+0000 7f63df7fe700 1 --2- 172.21.15.3:0/1340148340 >> v2:172.21.15.136:3300/0 conn(0x7f63e00bdd60 0x7f63e006c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:53.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.203+0000 7f63d7fff700 1 --2- 172.21.15.3:0/1340148340 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63e006ee40 0x7f63e00bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:53.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.203+0000 7f63de7fc700 1 -- 172.21.15.3:0/1340148340 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106072091 0 0) 0x7f63e014ff80 con 0x7f63e006ea70 2023-03-06T14:15:53.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.203+0000 7f63de7fc700 1 -- 172.21.15.3:0/1340148340 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63cc0035b0 con 0x7f63e006ea70 2023-03-06T14:15:53.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.203+0000 7f63de7fc700 1 -- 172.21.15.3:0/1340148340 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 414938650 0 0) 0x7f63cc0035b0 con 0x7f63e006ea70 2023-03-06T14:15:53.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.203+0000 7f63df7fe700 1 -- 172.21.15.3:0/1340148340 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63e006ee40 msgr2=0x7f63e00bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:53.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.203+0000 7f63df7fe700 1 --2- 172.21.15.3:0/1340148340 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63e006ee40 0x7f63e00bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.203+0000 7f63df7fe700 1 -- 172.21.15.3:0/1340148340 >> v1:172.21.15.3:6789/0 conn(0x7f63e006ea70 legacy=0x7f63e01490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:53.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.203+0000 7f63df7fe700 1 -- 172.21.15.3:0/1340148340 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e00bce70 con 0x7f63e00bdd60 2023-03-06T14:15:53.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.203+0000 7f63d7fff700 1 --2- 172.21.15.3:0/1340148340 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63e006ee40 0x7f63e00bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:15:53.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.203+0000 7f63df7fe700 1 --2- 172.21.15.3:0/1340148340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63e00bdd60 0x7f63e006c8a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009d90 tx=0x7f63d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cba2a0f5157df2a server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:53.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.203+0000 7f63de7fc700 1 -- 172.21.15.3:0/1340148340 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d800e070 con 0x7f63e00bdd60 2023-03-06T14:15:53.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.203+0000 7f63de7fc700 1 -- 172.21.15.3:0/1340148340 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d8003a20 con 0x7f63e00bdd60 2023-03-06T14:15:53.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.203+0000 7f63de7fc700 1 -- 172.21.15.3:0/1340148340 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d00017f0 con 0x7f63e00bdd60 2023-03-06T14:15:53.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.204+0000 7f63e52f6700 1 -- 172.21.15.3:0/1340148340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63e00bdd60 msgr2=0x7f63e006c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:53.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.204+0000 7f63e52f6700 1 --2- 172.21.15.3:0/1340148340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63e00bdd60 0x7f63e006c8a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009d90 tx=0x7f63d800b330 comp rx=0 tx=0).stop 2023-03-06T14:15:53.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.204+0000 7f63e52f6700 1 -- 172.21.15.3:0/1340148340 shutdown_connections 2023-03-06T14:15:53.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.204+0000 7f63e52f6700 1 --2- 172.21.15.3:0/1340148340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63e00bdd60 0x7f63e006c8a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.204+0000 7f63e52f6700 1 --2- 172.21.15.3:0/1340148340 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63e006ee40 0x7f63e00bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.204+0000 7f63e52f6700 1 -- 172.21.15.3:0/1340148340 >> 172.21.15.3:0/1340148340 conn(0x7f63e00c2150 msgr2=0x7f63e00c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:53.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.204+0000 7f63e52f6700 1 -- 172.21.15.3:0/1340148340 shutdown_connections 2023-03-06T14:15:53.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.204+0000 7f63e52f6700 1 -- 172.21.15.3:0/1340148340 wait complete. 2023-03-06T14:15:53.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.205+0000 7f63e52f6700 1 Processor -- start 2023-03-06T14:15:53.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.205+0000 7f63e52f6700 1 -- start start 2023-03-06T14:15:53.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.206+0000 7f63e52f6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63e006ea70 0x7f63e014f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:53.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.206+0000 7f63e52f6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63e006ee40 0x7f63e00a74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:53.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.206+0000 7f63e52f6700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63e00bdd60 0x7f63e01e8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:53.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.206+0000 7f63e52f6700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e0153400 con 0x7f63e006ee40 2023-03-06T14:15:53.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.206+0000 7f63e52f6700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00a7010 con 0x7f63e006ea70 2023-03-06T14:15:53.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.206+0000 7f63e52f6700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00c0860 con 0x7f63e00bdd60 2023-03-06T14:15:53.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.206+0000 7f63d7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63e006ee40 0x7f63e00a74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:53.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.206+0000 7f63deffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63e006ea70 0x7f63e014f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:53.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.206+0000 7f63deffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63e006ea70 0x7f63e014f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.3:41440/0 (socket says 172.21.15.3:41440) 2023-03-06T14:15:53.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.206+0000 7f63df7fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63e00bdd60 0x7f63e01e8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:53.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.206+0000 7f63d7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63e006ee40 0x7f63e00a74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55352/0 (socket says 172.21.15.3:55352) 2023-03-06T14:15:53.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.206+0000 7f63deffd700 1 -- 172.21.15.3:0/2030664150 learned_addr learned my addr 172.21.15.3:0/2030664150 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:53.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.206+0000 7f63deffd700 1 -- 172.21.15.3:0/2030664150 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63e00bdd60 msgr2=0x7f63e01e8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:53.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.206+0000 7f63deffd700 1 --2- 172.21.15.3:0/2030664150 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63e00bdd60 0x7f63e01e8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.206+0000 7f63deffd700 1 -- 172.21.15.3:0/2030664150 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63e006ee40 msgr2=0x7f63e00a74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:53.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.206+0000 7f63deffd700 1 --2- 172.21.15.3:0/2030664150 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63e006ee40 0x7f63e00a74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.206+0000 7f63deffd700 1 -- 172.21.15.3:0/2030664150 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c80094a0 con 0x7f63e006ea70 2023-03-06T14:15:53.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.206+0000 7f63deffd700 1 --2- 172.21.15.3:0/2030664150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63e006ea70 0x7f63e014f000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f63d000c5a0 tx=0x7f63d000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:53.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.206+0000 7f63d77fe700 1 -- 172.21.15.3:0/2030664150 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d00074e0 con 0x7f63e006ea70 2023-03-06T14:15:53.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.207+0000 7f63d77fe700 1 -- 172.21.15.3:0/2030664150 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d0007640 con 0x7f63e006ea70 2023-03-06T14:15:53.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.207+0000 7f63e52f6700 1 -- 172.21.15.3:0/2030664150 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d8009a70 con 0x7f63e006ea70 2023-03-06T14:15:53.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.207+0000 7f63d77fe700 1 -- 172.21.15.3:0/2030664150 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0005a70 con 0x7f63e006ea70 2023-03-06T14:15:53.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.207+0000 7f63e52f6700 1 -- 172.21.15.3:0/2030664150 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e0150220 con 0x7f63e006ea70 2023-03-06T14:15:53.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.207+0000 7f63e52f6700 1 -- 172.21.15.3:0/2030664150 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e00bd150 con 0x7f63e006ea70 2023-03-06T14:15:53.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.208+0000 7f63d77fe700 1 -- 172.21.15.3:0/2030664150 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f63d0019030 con 0x7f63e006ea70 2023-03-06T14:15:53.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.208+0000 7f63d77fe700 1 --2- 172.21.15.3:0/2030664150 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f63c00682f0 0x7f63c006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:53.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.208+0000 7f63d77fe700 1 -- 172.21.15.3:0/2030664150 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f63d0084cb0 con 0x7f63e006ea70 2023-03-06T14:15:53.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.208+0000 7f63d7fff700 1 --2- 172.21.15.3:0/2030664150 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f63c00682f0 0x7f63c006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:53.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.209+0000 7f63d7fff700 1 --2- 172.21.15.3:0/2030664150 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f63c00682f0 0x7f63c006a7a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f63e0072590 tx=0x7f63c8009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:53.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.213+0000 7f63d77fe700 1 -- 172.21.15.3:0/2030664150 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f63d0051860 con 0x7f63e006ea70 2023-03-06T14:15:53.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.408+0000 7f63e52f6700 1 -- 172.21.15.3:0/2030664150 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63e00b8b80 con 0x7f63e006ea70 2023-03-06T14:15:53.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.410+0000 7f63d77fe700 1 -- 172.21.15.3:0/2030664150 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14133 (secure 0 0 0) 0x7f63d0017090 con 0x7f63e006ea70 2023-03-06T14:15:53.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:15:53.412 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":18,"fsid":"9aae2361-5af0-49eb-8f99-e7f69834fedf","created":"2023-03-06T14:15:33.357348+0000","modified":"2023-03-06T14:15:53.020315+0000","last_up_change":"2023-03-06T14:15:44.374764+0000","last_in_change":"2023-03-06T14:15:35.866803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T14:15:45.023761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T14:15:51.830917+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c92c9e49-8a23-48a5-87e5-51f184f73a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":96679},{"type":"v1","addr":"172.21.15.3:6809","nonce":96679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":96679},{"type":"v1","addr":"172.21.15.3:6811","nonce":96679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":96679},{"type":"v1","addr":"172.21.15.3:6818","nonce":96679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":96679},{"type":"v1","addr":"172.21.15.3:6814","nonce":96679}]},"public_addr":"172.21.15.3:6809/96679","cluster_addr":"172.21.15.3:6811/96679","heartbeat_back_addr":"172.21.15.3:6818/96679","heartbeat_front_addr":"172.21.15.3:6814/96679","state":["exists","up"]},{"osd":1,"uuid":"86ec9127-843f-4246-bfbe-e14ce3af7d17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":96681},{"type":"v1","addr":"172.21.15.3:6825","nonce":96681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":96681},{"type":"v1","addr":"172.21.15.3:6827","nonce":96681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":96681},{"type":"v1","addr":"172.21.15.3:6831","nonce":96681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":96681},{"type":"v1","addr":"172.21.15.3:6829","nonce":96681}]},"public_addr":"172.21.15.3:6825/96681","cluster_addr":"172.21.15.3:6827/96681","heartbeat_back_addr":"172.21.15.3:6831/96681","heartbeat_front_addr":"172.21.15.3:6829/96681","state":["exists","up"]},{"osd":2,"uuid":"67582de3-0f75-4cf0-84ca-e878986f99f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":96682},{"type":"v1","addr":"172.21.15.3:6815","nonce":96682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6817","nonce":96682},{"type":"v1","addr":"172.21.15.3:6819","nonce":96682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":96682},{"type":"v1","addr":"172.21.15.3:6823","nonce":96682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":96682},{"type":"v1","addr":"172.21.15.3:6821","nonce":96682}]},"public_addr":"172.21.15.3:6815/96682","cluster_addr":"172.21.15.3:6819/96682","heartbeat_back_addr":"172.21.15.3:6823/96682","heartbeat_front_addr":"172.21.15.3:6821/96682","state":["exists","up"]},{"osd":3,"uuid":"0fb8d708-4b38-4153-8a60-79741765d439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":96680},{"type":"v1","addr":"172.21.15.3:6801","nonce":96680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":96680},{"type":"v1","addr":"172.21.15.3:6803","nonce":96680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":96680},{"type":"v1","addr":"172.21.15.3:6807","nonce":96680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":96680},{"type":"v1","addr":"172.21.15.3:6805","nonce":96680}]},"public_addr":"172.21.15.3:6801/96680","cluster_addr":"172.21.15.3:6803/96680","heartbeat_back_addr":"172.21.15.3:6807/96680","heartbeat_front_addr":"172.21.15.3:6805/96680","state":["exists","up"]},{"osd":4,"uuid":"44eb9d99-975f-43a3-8bf4-213b2ba6dea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":96798},{"type":"v1","addr":"172.21.15.136:6822","nonce":96798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":96798},{"type":"v1","addr":"172.21.15.136:6826","nonce":96798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":96798},{"type":"v1","addr":"172.21.15.136:6831","nonce":96798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":96798},{"type":"v1","addr":"172.21.15.136:6829","nonce":96798}]},"public_addr":"172.21.15.136:6822/96798","cluster_addr":"172.21.15.136:6826/96798","heartbeat_back_addr":"172.21.15.136:6831/96798","heartbeat_front_addr":"172.21.15.136:6829/96798","state":["exists","up"]},{"osd":5,"uuid":"aff1a438-c444-4ebc-9806-d2d117878a2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":96796},{"type":"v1","addr":"172.21.15.136:6804","nonce":96796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":96796},{"type":"v1","addr":"172.21.15.136:6809","nonce":96796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":96796},{"type":"v1","addr":"172.21.15.136:6815","nonce":96796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":96796},{"type":"v1","addr":"172.21.15.136:6813","nonce":96796}]},"public_addr":"172.21.15.136:6804/96796","cluster_addr":"172.21.15.136:6809/96796","heartbeat_back_addr":"172.21.15.136:6815/96796","heartbeat_front_addr":"172.21.15.136:6813/96796","state":["exists","up"]},{"osd":6,"uuid":"89cc219c-f57b-43f4-8e54-76017dd4930d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":96797},{"type":"v1","addr":"172.21.15.136:6801","nonce":96797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6803","nonce":96797},{"type":"v1","addr":"172.21.15.136:6805","nonce":96797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":96797},{"type":"v1","addr":"172.21.15.136:6811","nonce":96797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":96797},{"type":"v1","addr":"172.21.15.136:6808","nonce":96797}]},"public_addr":"172.21.15.136:6801/96797","cluster_addr":"172.21.15.136:6805/96797","heartbeat_back_addr":"172.21.15.136:6811/96797","heartbeat_front_addr":"172.21.15.136:6808/96797","state":["exists","up"]},{"osd":7,"uuid":"a90e4c14-00de-4d1c-92ce-9f20df714e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":96819},{"type":"v1","addr":"172.21.15.136:6817","nonce":96819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":96819},{"type":"v1","addr":"172.21.15.136:6819","nonce":96819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":96819},{"type":"v1","addr":"172.21.15.136:6827","nonce":96819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":96819},{"type":"v1","addr":"172.21.15.136:6823","nonce":96819}]},"public_addr":"172.21.15.136:6817/96819","cluster_addr":"172.21.15.136:6819/96819","heartbeat_back_addr":"172.21.15.136:6827/96819","heartbeat_front_addr":"172.21.15.136:6823/96819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.093141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.034488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.128137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.097924+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.045441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.005820+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.039918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.082053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T14:15:53.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.411+0000 7f63e52f6700 1 -- 172.21.15.3:0/2030664150 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f63c00682f0 msgr2=0x7f63c006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:53.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.411+0000 7f63e52f6700 1 --2- 172.21.15.3:0/2030664150 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f63c00682f0 0x7f63c006a7a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f63e0072590 tx=0x7f63c8009210 comp rx=0 tx=0).stop 2023-03-06T14:15:53.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.411+0000 7f63e52f6700 1 -- 172.21.15.3:0/2030664150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63e006ea70 msgr2=0x7f63e014f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:53.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.411+0000 7f63e52f6700 1 --2- 172.21.15.3:0/2030664150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63e006ea70 0x7f63e014f000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f63d000c5a0 tx=0x7f63d000c8b0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.411+0000 7f63e52f6700 1 -- 172.21.15.3:0/2030664150 shutdown_connections 2023-03-06T14:15:53.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.411+0000 7f63e52f6700 1 --2- 172.21.15.3:0/2030664150 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f63c00682f0 0x7f63c006a7a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.411+0000 7f63e52f6700 1 --2- 172.21.15.3:0/2030664150 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63e00bdd60 0x7f63e01e8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.411+0000 7f63e52f6700 1 --2- 172.21.15.3:0/2030664150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63e006ea70 0x7f63e014f000 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.411+0000 7f63e52f6700 1 --2- 172.21.15.3:0/2030664150 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63e006ee40 0x7f63e00a74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.411+0000 7f63e52f6700 1 -- 172.21.15.3:0/2030664150 >> 172.21.15.3:0/2030664150 conn(0x7f63e00c2150 msgr2=0x7f63e00c0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:53.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.411+0000 7f63e52f6700 1 -- 172.21.15.3:0/2030664150 shutdown_connections 2023-03-06T14:15:53.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.411+0000 7f63e52f6700 1 -- 172.21.15.3:0/2030664150 wait complete. 2023-03-06T14:15:53.426 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-06T14:15:45.023761+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-06T14:15:51.830917+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-06T14:15:53.427 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-06T14:15:53.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.551+0000 7ff09299e700 1 Processor -- start 2023-03-06T14:15:53.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.551+0000 7ff09299e700 1 -- start start 2023-03-06T14:15:53.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.551+0000 7ff09299e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff08c145bd0 0x7ff08c06bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:53.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.552+0000 7ff09299e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff08c1543b0 0x7ff08c156790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:53.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.552+0000 7ff09299e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff08c0a2e40 con 0x7ff08c0bd650 2023-03-06T14:15:53.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.552+0000 7ff09299e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff08c06a8f0 con 0x7ff08c1543b0 2023-03-06T14:15:53.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.552+0000 7ff09299e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c145fa0 con 0x7ff08c145bd0 2023-03-06T14:15:53.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.552+0000 7ff09219d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff08c1543b0 0x7ff08c156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:53.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.552+0000 7ff09219d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff08c1543b0 0x7ff08c156790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55360/0 (socket says 172.21.15.3:55360) 2023-03-06T14:15:53.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.552+0000 7ff09119b700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7ff08c0bd650 0x7ff08c0c1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57630/0 (socket says 172.21.15.3:57630) 2023-03-06T14:15:53.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.552+0000 7ff09219d700 1 -- 172.21.15.3:0/3440707492 learned_addr learned my addr 172.21.15.3:0/3440707492 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:53.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.552+0000 7ff09199c700 1 --2- 172.21.15.3:0/3440707492 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff08c145bd0 0x7ff08c06bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:53.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.552+0000 7ff09219d700 1 -- 172.21.15.3:0/3440707492 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff08c145bd0 msgr2=0x7ff08c06bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.552+0000 7ff09219d700 1 --2- 172.21.15.3:0/3440707492 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff08c145bd0 0x7ff08c06bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.552+0000 7ff09219d700 1 -- 172.21.15.3:0/3440707492 >> v1:172.21.15.3:6789/0 conn(0x7ff08c0bd650 legacy=0x7ff08c0c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.552+0000 7ff09219d700 1 -- 172.21.15.3:0/3440707492 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c06c280 con 0x7ff08c1543b0 2023-03-06T14:15:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.552+0000 7ff09099a700 1 -- 172.21.15.3:0/3440707492 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699042688 0 0) 0x7ff08c0a2e40 con 0x7ff08c0bd650 2023-03-06T14:15:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.552+0000 7ff09219d700 1 --2- 172.21.15.3:0/3440707492 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff08c1543b0 0x7ff08c156790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff084009e80 tx=0x7ff08400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55bacc4f5e90718 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.552+0000 7ff09099a700 1 -- 172.21.15.3:0/3440707492 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08400e070 con 0x7ff08c1543b0 2023-03-06T14:15:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.552+0000 7ff09099a700 1 -- 172.21.15.3:0/3440707492 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08400b8d0 con 0x7ff08c1543b0 2023-03-06T14:15:53.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.552+0000 7ff09099a700 1 -- 172.21.15.3:0/3440707492 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08400bc80 con 0x7ff08c1543b0 2023-03-06T14:15:53.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.553+0000 7ff09299e700 1 -- 172.21.15.3:0/3440707492 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff08c1543b0 msgr2=0x7ff08c156790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:53.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.553+0000 7ff09299e700 1 --2- 172.21.15.3:0/3440707492 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff08c1543b0 0x7ff08c156790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff084009e80 tx=0x7ff08400b330 comp rx=0 tx=0).stop 2023-03-06T14:15:53.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.553+0000 7ff09299e700 1 -- 172.21.15.3:0/3440707492 shutdown_connections 2023-03-06T14:15:53.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.553+0000 7ff09299e700 1 --2- 172.21.15.3:0/3440707492 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff08c1543b0 0x7ff08c156790 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.553+0000 7ff09299e700 1 --2- 172.21.15.3:0/3440707492 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff08c145bd0 0x7ff08c06bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.553+0000 7ff09299e700 1 -- 172.21.15.3:0/3440707492 >> 172.21.15.3:0/3440707492 conn(0x7ff08c0a3e80 msgr2=0x7ff08c0c14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:53.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.553+0000 7ff09299e700 1 -- 172.21.15.3:0/3440707492 shutdown_connections 2023-03-06T14:15:53.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.553+0000 7ff09299e700 1 -- 172.21.15.3:0/3440707492 wait complete. 2023-03-06T14:15:53.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.554+0000 7ff09299e700 1 Processor -- start 2023-03-06T14:15:53.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.554+0000 7ff09299e700 1 -- start start 2023-03-06T14:15:53.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.555+0000 7ff09299e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff08c0bd650 0x7ff08c13dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:53.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.555+0000 7ff09299e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff08c145bd0 0x7ff08c14e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:53.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.555+0000 7ff09299e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff08c1543b0 0x7ff08c0a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:53.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.555+0000 7ff09299e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c13ee60 con 0x7ff08c145bd0 2023-03-06T14:15:53.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.555+0000 7ff09299e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c14bdc0 con 0x7ff08c1543b0 2023-03-06T14:15:53.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.555+0000 7ff09299e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c1e84c0 con 0x7ff08c0bd650 2023-03-06T14:15:53.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.555+0000 7ff09119b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff08c145bd0 0x7ff08c14e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:53.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.555+0000 7ff09119b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff08c145bd0 0x7ff08c14e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55364/0 (socket says 172.21.15.3:55364) 2023-03-06T14:15:53.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.555+0000 7ff09119b700 1 -- 172.21.15.3:0/1155115957 learned_addr learned my addr 172.21.15.3:0/1155115957 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:53.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.555+0000 7ff09219d700 1 --2- 172.21.15.3:0/1155115957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff08c1543b0 0x7ff08c0a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:53.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.555+0000 7ff09199c700 1 --2- 172.21.15.3:0/1155115957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff08c0bd650 0x7ff08c13dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:53.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.555+0000 7ff09119b700 1 -- 172.21.15.3:0/1155115957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff08c0bd650 msgr2=0x7ff08c13dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:53.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.555+0000 7ff09119b700 1 --2- 172.21.15.3:0/1155115957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff08c0bd650 0x7ff08c13dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.555+0000 7ff09119b700 1 -- 172.21.15.3:0/1155115957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff08c1543b0 msgr2=0x7ff08c0a47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:53.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.555+0000 7ff09119b700 1 --2- 172.21.15.3:0/1155115957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff08c1543b0 0x7ff08c0a47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.555+0000 7ff09119b700 1 -- 172.21.15.3:0/1155115957 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff084009b30 con 0x7ff08c145bd0 2023-03-06T14:15:53.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.555+0000 7ff09119b700 1 --2- 172.21.15.3:0/1155115957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff08c145bd0 0x7ff08c14e4e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00c580 tx=0x7ff07c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:53.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.556+0000 7ff0827fc700 1 -- 172.21.15.3:0/1155115957 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c004c80 con 0x7ff08c145bd0 2023-03-06T14:15:53.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.556+0000 7ff0827fc700 1 -- 172.21.15.3:0/1155115957 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07c004e00 con 0x7ff08c145bd0 2023-03-06T14:15:53.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.556+0000 7ff09299e700 1 -- 172.21.15.3:0/1155115957 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08c06b820 con 0x7ff08c145bd0 2023-03-06T14:15:53.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.556+0000 7ff0827fc700 1 -- 172.21.15.3:0/1155115957 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c007310 con 0x7ff08c145bd0 2023-03-06T14:15:53.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.556+0000 7ff09299e700 1 -- 172.21.15.3:0/1155115957 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08c14c640 con 0x7ff08c145bd0 2023-03-06T14:15:53.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.557+0000 7ff09299e700 1 -- 172.21.15.3:0/1155115957 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff08c0bd1d0 con 0x7ff08c145bd0 2023-03-06T14:15:53.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.557+0000 7ff0827fc700 1 -- 172.21.15.3:0/1155115957 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff07c01a020 con 0x7ff08c145bd0 2023-03-06T14:15:53.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.557+0000 7ff0827fc700 1 --2- 172.21.15.3:0/1155115957 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7ff0700682f0 0x7ff07006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:53.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.558+0000 7ff0827fc700 1 -- 172.21.15.3:0/1155115957 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff07c085390 con 0x7ff08c145bd0 2023-03-06T14:15:53.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.558+0000 7ff09199c700 1 --2- 172.21.15.3:0/1155115957 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7ff0700682f0 0x7ff07006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:53.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.558+0000 7ff09199c700 1 --2- 172.21.15.3:0/1155115957 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7ff0700682f0 0x7ff07006a7a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff088009b40 tx=0x7ff088009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:53.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.562+0000 7ff0827fc700 1 -- 172.21.15.3:0/1155115957 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff07c051f40 con 0x7ff08c145bd0 2023-03-06T14:15:53.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.752+0000 7ff09299e700 1 -- 172.21.15.3:0/1155115957 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff08c13e1c0 con 0x7ff08c145bd0 2023-03-06T14:15:53.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.753+0000 7ff0827fc700 1 -- 172.21.15.3:0/1155115957 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff07c055560 con 0x7ff08c145bd0 2023-03-06T14:15:53.755 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-03-06T14:15:53.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.755+0000 7ff09299e700 1 -- 172.21.15.3:0/1155115957 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7ff0700682f0 msgr2=0x7ff07006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:53.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.755+0000 7ff09299e700 1 --2- 172.21.15.3:0/1155115957 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7ff0700682f0 0x7ff07006a7a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff088009b40 tx=0x7ff088009210 comp rx=0 tx=0).stop 2023-03-06T14:15:53.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.755+0000 7ff09299e700 1 -- 172.21.15.3:0/1155115957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff08c145bd0 msgr2=0x7ff08c14e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:53.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.755+0000 7ff09299e700 1 --2- 172.21.15.3:0/1155115957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff08c145bd0 0x7ff08c14e4e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00c580 tx=0x7ff07c00c890 comp rx=0 tx=0).stop 2023-03-06T14:15:53.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.755+0000 7ff09299e700 1 -- 172.21.15.3:0/1155115957 shutdown_connections 2023-03-06T14:15:53.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.755+0000 7ff09299e700 1 --2- 172.21.15.3:0/1155115957 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7ff0700682f0 0x7ff07006a7a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.755+0000 7ff09299e700 1 --2- 172.21.15.3:0/1155115957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff08c1543b0 0x7ff08c0a47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.755+0000 7ff09299e700 1 --2- 172.21.15.3:0/1155115957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff08c0bd650 0x7ff08c13dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.755+0000 7ff09299e700 1 --2- 172.21.15.3:0/1155115957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff08c145bd0 0x7ff08c14e4e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.755+0000 7ff09299e700 1 -- 172.21.15.3:0/1155115957 >> 172.21.15.3:0/1155115957 conn(0x7ff08c0a3e80 msgr2=0x7ff08c070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:53.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.755+0000 7ff09299e700 1 -- 172.21.15.3:0/1155115957 shutdown_connections 2023-03-06T14:15:53.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.755+0000 7ff09299e700 1 -- 172.21.15.3:0/1155115957 wait complete. 2023-03-06T14:15:53.769 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-06T14:15:53.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.895+0000 7fbfabc39700 1 Processor -- start 2023-03-06T14:15:53.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.895+0000 7fbfabc39700 1 -- start start 2023-03-06T14:15:53.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.896+0000 7fbfabc39700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbfa406ea70 0x7fbfa40bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:53.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.896+0000 7fbfabc39700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbfa40bdd60 0x7fbfa406c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:53.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.896+0000 7fbfabc39700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa414ff80 con 0x7fbfa406ee40 2023-03-06T14:15:53.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.896+0000 7fbfabc39700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa40b9070 con 0x7fbfa40bdd60 2023-03-06T14:15:53.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.896+0000 7fbfabc39700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa40bcb90 con 0x7fbfa406ea70 2023-03-06T14:15:53.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.896+0000 7fbfa91d4700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fbfa406ee40 0x7fbfa41490f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57644/0 (socket says 172.21.15.3:57644) 2023-03-06T14:15:53.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.896+0000 7fbfa91d4700 1 -- 172.21.15.3:0/736793547 learned_addr learned my addr 172.21.15.3:0/736793547 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:15:53.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.896+0000 7fbfa99d5700 1 --2- 172.21.15.3:0/736793547 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbfa406ea70 0x7fbfa40bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:53.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.896+0000 7fbfaa1d6700 1 --2- 172.21.15.3:0/736793547 >> v2:172.21.15.136:3300/0 conn(0x7fbfa40bdd60 0x7fbfa406c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:53.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.896+0000 7fbfa89d3700 1 -- 172.21.15.3:0/736793547 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691726422 0 0) 0x7fbfa414ff80 con 0x7fbfa406ee40 2023-03-06T14:15:53.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.896+0000 7fbfa89d3700 1 -- 172.21.15.3:0/736793547 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf900035b0 con 0x7fbfa406ee40 2023-03-06T14:15:53.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.897+0000 7fbfaa1d6700 1 -- 172.21.15.3:0/736793547 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbfa406ea70 msgr2=0x7fbfa40bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:53.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.897+0000 7fbfa89d3700 1 -- 172.21.15.3:0/736793547 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1209573354 0 0) 0x7fbf900035b0 con 0x7fbfa406ee40 2023-03-06T14:15:53.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.897+0000 7fbfaa1d6700 1 --2- 172.21.15.3:0/736793547 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbfa406ea70 0x7fbfa40bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.897+0000 7fbfaa1d6700 1 -- 172.21.15.3:0/736793547 >> v1:172.21.15.3:6789/0 conn(0x7fbfa406ee40 legacy=0x7fbfa41490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:53.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.897+0000 7fbfaa1d6700 1 -- 172.21.15.3:0/736793547 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa40bce70 con 0x7fbfa40bdd60 2023-03-06T14:15:53.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.897+0000 7fbfa99d5700 1 --2- 172.21.15.3:0/736793547 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbfa406ea70 0x7fbfa40bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:15:53.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.897+0000 7fbfaa1d6700 1 --2- 172.21.15.3:0/736793547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa40bdd60 0x7fbfa406c8a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c009d90 tx=0x7fbf9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=312bdf11a9d5254b server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:53.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.897+0000 7fbfa89d3700 1 -- 172.21.15.3:0/736793547 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c00e070 con 0x7fbfa40bdd60 2023-03-06T14:15:53.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.897+0000 7fbfa89d3700 1 -- 172.21.15.3:0/736793547 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c003a20 con 0x7fbfa40bdd60 2023-03-06T14:15:53.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.897+0000 7fbfa89d3700 1 -- 172.21.15.3:0/736793547 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0001670 con 0x7fbfa40bdd60 2023-03-06T14:15:53.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.897+0000 7fbfabc39700 1 -- 172.21.15.3:0/736793547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa40bdd60 msgr2=0x7fbfa406c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:53.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.897+0000 7fbfabc39700 1 --2- 172.21.15.3:0/736793547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa40bdd60 0x7fbfa406c8a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c009d90 tx=0x7fbf9c00b330 comp rx=0 tx=0).stop 2023-03-06T14:15:53.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.898+0000 7fbfabc39700 1 -- 172.21.15.3:0/736793547 shutdown_connections 2023-03-06T14:15:53.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.898+0000 7fbfabc39700 1 --2- 172.21.15.3:0/736793547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa40bdd60 0x7fbfa406c8a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.898+0000 7fbfabc39700 1 --2- 172.21.15.3:0/736793547 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbfa406ea70 0x7fbfa40bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.898+0000 7fbfabc39700 1 -- 172.21.15.3:0/736793547 >> 172.21.15.3:0/736793547 conn(0x7fbfa40c2150 msgr2=0x7fbfa40c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:53.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.898+0000 7fbfabc39700 1 -- 172.21.15.3:0/736793547 shutdown_connections 2023-03-06T14:15:53.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.898+0000 7fbfabc39700 1 -- 172.21.15.3:0/736793547 wait complete. 2023-03-06T14:15:53.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.899+0000 7fbfabc39700 1 Processor -- start 2023-03-06T14:15:53.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.899+0000 7fbfabc39700 1 -- start start 2023-03-06T14:15:53.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.899+0000 7fbfabc39700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbfa406ea70 0x7fbfa40a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:53.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbfabc39700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa406ee40 0x7fbfa40a5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:53.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbfabc39700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbfa40bdd60 0x7fbfa40a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:53.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbfabc39700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa4153200 con 0x7fbfa406ea70 2023-03-06T14:15:53.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbfabc39700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa40a7820 con 0x7fbfa406ee40 2023-03-06T14:15:53.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbfabc39700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa41e89c0 con 0x7fbfa40bdd60 2023-03-06T14:15:53.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbfa99d5700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbfa406ea70 0x7fbfa40a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:53.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbfa99d5700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbfa406ea70 0x7fbfa40a72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55376/0 (socket says 172.21.15.3:55376) 2023-03-06T14:15:53.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbfa99d5700 1 -- 172.21.15.3:0/4066650805 learned_addr learned my addr 172.21.15.3:0/4066650805 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:53.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbfa91d4700 1 --2- 172.21.15.3:0/4066650805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa406ee40 0x7fbfa40a5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:53.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbfaa1d6700 1 --2- 172.21.15.3:0/4066650805 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbfa40bdd60 0x7fbfa40a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:53.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbfa99d5700 1 -- 172.21.15.3:0/4066650805 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbfa40bdd60 msgr2=0x7fbfa40a62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:53.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbfa99d5700 1 --2- 172.21.15.3:0/4066650805 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbfa40bdd60 0x7fbfa40a62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbfa99d5700 1 -- 172.21.15.3:0/4066650805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa406ee40 msgr2=0x7fbfa40a5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:53.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbfa99d5700 1 --2- 172.21.15.3:0/4066650805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa406ee40 0x7fbfa40a5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:53.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbfa99d5700 1 -- 172.21.15.3:0/4066650805 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf94009430 con 0x7fbfa406ea70 2023-03-06T14:15:53.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbfa99d5700 1 --2- 172.21.15.3:0/4066650805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbfa406ea70 0x7fbfa40a72e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400ebe0 tx=0x7fbf9400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:53.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbf9a7fc700 1 -- 172.21.15.3:0/4066650805 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf94005a20 con 0x7fbfa406ea70 2023-03-06T14:15:53.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbfabc39700 1 -- 172.21.15.3:0/4066650805 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9c009a70 con 0x7fbfa406ea70 2023-03-06T14:15:53.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbf9a7fc700 1 -- 172.21.15.3:0/4066650805 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf94005b80 con 0x7fbfa406ea70 2023-03-06T14:15:53.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbf9a7fc700 1 -- 172.21.15.3:0/4066650805 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9400c850 con 0x7fbfa406ea70 2023-03-06T14:15:53.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.900+0000 7fbfabc39700 1 -- 172.21.15.3:0/4066650805 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa4150220 con 0x7fbfa406ea70 2023-03-06T14:15:53.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.901+0000 7fbfabc39700 1 -- 172.21.15.3:0/4066650805 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa40bd150 con 0x7fbfa406ea70 2023-03-06T14:15:53.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.902+0000 7fbf9a7fc700 1 -- 172.21.15.3:0/4066650805 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbf94022070 con 0x7fbfa406ea70 2023-03-06T14:15:53.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.902+0000 7fbf9a7fc700 1 --2- 172.21.15.3:0/4066650805 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fbf880682f0 0x7fbf8806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:53.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.902+0000 7fbf9a7fc700 1 -- 172.21.15.3:0/4066650805 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbf94085b30 con 0x7fbfa406ea70 2023-03-06T14:15:53.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.902+0000 7fbfa91d4700 1 --2- 172.21.15.3:0/4066650805 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fbf880682f0 0x7fbf8806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:53.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.903+0000 7fbfa91d4700 1 --2- 172.21.15.3:0/4066650805 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fbf880682f0 0x7fbf8806a7a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbfa414c830 tx=0x7fbfa0001230 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:53.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:53.906+0000 7fbf9a7fc700 1 -- 172.21.15.3:0/4066650805 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbf94052570 con 0x7fbfa406ea70 2023-03-06T14:15:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.103+0000 7fbfabc39700 1 -- 172.21.15.3:0/4066650805 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbfa40b8b80 con 0x7fbfa406ea70 2023-03-06T14:15:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.103+0000 7fbf9a7fc700 1 -- 172.21.15.3:0/4066650805 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbf94020020 con 0x7fbfa406ea70 2023-03-06T14:15:54.106 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-03-06T14:15:54.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.105+0000 7fbfabc39700 1 -- 172.21.15.3:0/4066650805 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fbf880682f0 msgr2=0x7fbf8806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:54.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.105+0000 7fbfabc39700 1 --2- 172.21.15.3:0/4066650805 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fbf880682f0 0x7fbf8806a7a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbfa414c830 tx=0x7fbfa0001230 comp rx=0 tx=0).stop 2023-03-06T14:15:54.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.105+0000 7fbfabc39700 1 -- 172.21.15.3:0/4066650805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbfa406ea70 msgr2=0x7fbfa40a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:54.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.105+0000 7fbfabc39700 1 --2- 172.21.15.3:0/4066650805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbfa406ea70 0x7fbfa40a72e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400ebe0 tx=0x7fbf9400eef0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.105+0000 7fbfabc39700 1 -- 172.21.15.3:0/4066650805 shutdown_connections 2023-03-06T14:15:54.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.105+0000 7fbfabc39700 1 --2- 172.21.15.3:0/4066650805 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fbf880682f0 0x7fbf8806a7a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.105+0000 7fbfabc39700 1 --2- 172.21.15.3:0/4066650805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbfa406ea70 0x7fbfa40a72e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.105+0000 7fbfabc39700 1 --2- 172.21.15.3:0/4066650805 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbfa40bdd60 0x7fbfa40a62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.105+0000 7fbfabc39700 1 --2- 172.21.15.3:0/4066650805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa406ee40 0x7fbfa40a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.105+0000 7fbfabc39700 1 -- 172.21.15.3:0/4066650805 >> 172.21.15.3:0/4066650805 conn(0x7fbfa40c2150 msgr2=0x7fbfa414b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:54.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.105+0000 7fbfabc39700 1 -- 172.21.15.3:0/4066650805 shutdown_connections 2023-03-06T14:15:54.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.106+0000 7fbfabc39700 1 -- 172.21.15.3:0/4066650805 wait complete. 2023-03-06T14:15:54.120 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-06T14:15:54.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.244+0000 7f86106a5700 1 Processor -- start 2023-03-06T14:15:54.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.244+0000 7f86106a5700 1 -- start start 2023-03-06T14:15:54.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.244+0000 7f86106a5700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f860806ee40 0x7f86080bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:54.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.244+0000 7f86106a5700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86080bdd60 0x7f860806c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:54.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.244+0000 7f86106a5700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860814ff80 con 0x7f860806ea70 2023-03-06T14:15:54.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.244+0000 7f86106a5700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86080b9070 con 0x7f860806ee40 2023-03-06T14:15:54.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.244+0000 7f86106a5700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86080bcb90 con 0x7f86080bdd60 2023-03-06T14:15:54.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.245+0000 7f860ec42700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86080bdd60 0x7f860806c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:54.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.245+0000 7f860dc40700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f860806ee40 0x7f86080bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:54.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.245+0000 7f860ec42700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86080bdd60 0x7f860806c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.3:48372/0 (socket says 172.21.15.3:48372) 2023-03-06T14:15:54.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.245+0000 7f860ec42700 1 -- 172.21.15.3:0/2219210552 learned_addr learned my addr 172.21.15.3:0/2219210552 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:54.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.245+0000 7f860e441700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f860806ea70 0x7f86081490f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.3:55146/0 (socket says 172.21.15.3:55146) 2023-03-06T14:15:54.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.245+0000 7f860dc40700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f860806ee40 0x7f86080bd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.3:41480/0 (socket says 172.21.15.3:41480) 2023-03-06T14:15:54.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.245+0000 7f860ec42700 1 -- 172.21.15.3:0/2219210552 >> v2:172.21.15.136:3300/0 conn(0x7f860806ee40 msgr2=0x7f86080bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:54.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.245+0000 7f860ec42700 1 --2- 172.21.15.3:0/2219210552 >> v2:172.21.15.136:3300/0 conn(0x7f860806ee40 0x7f86080bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.245+0000 7f860ec42700 1 -- 172.21.15.3:0/2219210552 >> v1:172.21.15.136:6789/0 conn(0x7f860806ea70 legacy=0x7f86081490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:54.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.245+0000 7f860ec42700 1 -- 172.21.15.3:0/2219210552 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86080bce70 con 0x7f86080bdd60 2023-03-06T14:15:54.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.245+0000 7f860dc40700 1 --2- 172.21.15.3:0/2219210552 >> v2:172.21.15.136:3300/0 conn(0x7f860806ee40 0x7f86080bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:15:54.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.245+0000 7f860ec42700 1 --2- 172.21.15.3:0/2219210552 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86080bdd60 0x7f860806c8a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8600009e50 tx=0x7f860000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42dd76a3a7bb40f2 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:54.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.246+0000 7f860d43f700 1 -- 172.21.15.3:0/2219210552 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860000e070 con 0x7f86080bdd60 2023-03-06T14:15:54.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.246+0000 7f860d43f700 1 -- 172.21.15.3:0/2219210552 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860000b910 con 0x7f86080bdd60 2023-03-06T14:15:54.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.246+0000 7f860d43f700 1 -- 172.21.15.3:0/2219210552 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860000bcc0 con 0x7f86080bdd60 2023-03-06T14:15:54.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.246+0000 7f86106a5700 1 -- 172.21.15.3:0/2219210552 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86080bdd60 msgr2=0x7f860806c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:54.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.246+0000 7f86106a5700 1 --2- 172.21.15.3:0/2219210552 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86080bdd60 0x7f860806c8a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8600009e50 tx=0x7f860000b330 comp rx=0 tx=0).stop 2023-03-06T14:15:54.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.246+0000 7f86106a5700 1 -- 172.21.15.3:0/2219210552 shutdown_connections 2023-03-06T14:15:54.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.246+0000 7f86106a5700 1 --2- 172.21.15.3:0/2219210552 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86080bdd60 0x7f860806c8a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.246+0000 7f86106a5700 1 --2- 172.21.15.3:0/2219210552 >> v2:172.21.15.136:3300/0 conn(0x7f860806ee40 0x7f86080bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.246+0000 7f86106a5700 1 -- 172.21.15.3:0/2219210552 >> 172.21.15.3:0/2219210552 conn(0x7f86080c2150 msgr2=0x7f86080c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:54.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.246+0000 7f86106a5700 1 -- 172.21.15.3:0/2219210552 shutdown_connections 2023-03-06T14:15:54.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.246+0000 7f86106a5700 1 -- 172.21.15.3:0/2219210552 wait complete. 2023-03-06T14:15:54.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.247+0000 7f86106a5700 1 Processor -- start 2023-03-06T14:15:54.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.247+0000 7f86106a5700 1 -- start start 2023-03-06T14:15:54.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.248+0000 7f86106a5700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f860806ea70 0x7f860814e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:54.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.248+0000 7f86106a5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f860806ee40 0x7f8608136e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:54.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.248+0000 7f86106a5700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86080bdd60 0x7f86081373a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:54.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.248+0000 7f86106a5700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860814afd0 con 0x7f860806ea70 2023-03-06T14:15:54.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.248+0000 7f86106a5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860814ed40 con 0x7f860806ee40 2023-03-06T14:15:54.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.248+0000 7f86106a5700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86081e50d0 con 0x7f86080bdd60 2023-03-06T14:15:54.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.248+0000 7f860e441700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f860806ea70 0x7f860814e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:54.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.248+0000 7f860e441700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f860806ea70 0x7f860814e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55394/0 (socket says 172.21.15.3:55394) 2023-03-06T14:15:54.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.248+0000 7f860e441700 1 -- 172.21.15.3:0/3498134066 learned_addr learned my addr 172.21.15.3:0/3498134066 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:54.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.248+0000 7f860ec42700 1 --2- 172.21.15.3:0/3498134066 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86080bdd60 0x7f86081373a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:54.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.248+0000 7f860dc40700 1 --2- 172.21.15.3:0/3498134066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f860806ee40 0x7f8608136e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:54.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.248+0000 7f860e441700 1 -- 172.21.15.3:0/3498134066 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86080bdd60 msgr2=0x7f86081373a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:54.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.248+0000 7f860e441700 1 --2- 172.21.15.3:0/3498134066 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86080bdd60 0x7f86081373a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.248+0000 7f860e441700 1 -- 172.21.15.3:0/3498134066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f860806ee40 msgr2=0x7f8608136e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:54.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.248+0000 7f860e441700 1 --2- 172.21.15.3:0/3498134066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f860806ee40 0x7f8608136e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.248+0000 7f860e441700 1 -- 172.21.15.3:0/3498134066 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f80094a0 con 0x7f860806ea70 2023-03-06T14:15:54.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.249+0000 7f860e441700 1 --2- 172.21.15.3:0/3498134066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f860806ea70 0x7f860814e800 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f860400c6b0 tx=0x7f860400ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:54.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.249+0000 7f85feffd700 1 -- 172.21.15.3:0/3498134066 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604005d00 con 0x7f860806ea70 2023-03-06T14:15:54.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.249+0000 7f85feffd700 1 -- 172.21.15.3:0/3498134066 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8604005e60 con 0x7f860806ea70 2023-03-06T14:15:54.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.249+0000 7f86106a5700 1 -- 172.21.15.3:0/3498134066 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8600009b30 con 0x7f860806ea70 2023-03-06T14:15:54.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.249+0000 7f85feffd700 1 -- 172.21.15.3:0/3498134066 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604007310 con 0x7f860806ea70 2023-03-06T14:15:54.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.249+0000 7f86106a5700 1 -- 172.21.15.3:0/3498134066 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8608150220 con 0x7f860806ea70 2023-03-06T14:15:54.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.250+0000 7f86106a5700 1 -- 172.21.15.3:0/3498134066 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86080bd150 con 0x7f860806ea70 2023-03-06T14:15:54.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.250+0000 7f85feffd700 1 -- 172.21.15.3:0/3498134066 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8604019030 con 0x7f860806ea70 2023-03-06T14:15:54.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.251+0000 7f85feffd700 1 --2- 172.21.15.3:0/3498134066 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f85ec0682f0 0x7f85ec06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:54.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.251+0000 7f85feffd700 1 -- 172.21.15.3:0/3498134066 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8604084d00 con 0x7f860806ea70 2023-03-06T14:15:54.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.251+0000 7f860dc40700 1 --2- 172.21.15.3:0/3498134066 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f85ec0682f0 0x7f85ec06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:54.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.252+0000 7f860dc40700 1 --2- 172.21.15.3:0/3498134066 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f85ec0682f0 0x7f85ec06a7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f860806c9d0 tx=0x7f85f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:54.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.255+0000 7f85feffd700 1 -- 172.21.15.3:0/3498134066 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8604088030 con 0x7f860806ea70 2023-03-06T14:15:54.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.492+0000 7f86106a5700 1 -- 172.21.15.3:0/3498134066 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86080b8b80 con 0x7f860806ea70 2023-03-06T14:15:54.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.492+0000 7f85feffd700 1 -- 172.21.15.3:0/3498134066 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7f8604017090 con 0x7f860806ea70 2023-03-06T14:15:54.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:15:54.495 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/3666647721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3666647721},{"type":"v1","addr":"172.21.15.136:6835","nonce":3666647721}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6834/1347040159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":1347040159},{"type":"v1","addr":"172.21.15.3:6834","nonce":1347040159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2387644382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2387644382},{"type":"v1","addr":"172.21.15.136:6837","nonce":2387644382}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/3655666630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6833","nonce":3655666630},{"type":"v1","addr":"172.21.15.3:6835","nonce":3655666630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-03-06T14:15:54.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.494+0000 7f86106a5700 1 -- 172.21.15.3:0/3498134066 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f85ec0682f0 msgr2=0x7f85ec06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:54.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.494+0000 7f86106a5700 1 --2- 172.21.15.3:0/3498134066 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f85ec0682f0 0x7f85ec06a7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f860806c9d0 tx=0x7f85f8008040 comp rx=0 tx=0).stop 2023-03-06T14:15:54.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.494+0000 7f86106a5700 1 -- 172.21.15.3:0/3498134066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f860806ea70 msgr2=0x7f860814e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:54.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.494+0000 7f86106a5700 1 --2- 172.21.15.3:0/3498134066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f860806ea70 0x7f860814e800 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f860400c6b0 tx=0x7f860400ca70 comp rx=0 tx=0).stop 2023-03-06T14:15:54.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.494+0000 7f86106a5700 1 -- 172.21.15.3:0/3498134066 shutdown_connections 2023-03-06T14:15:54.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.494+0000 7f86106a5700 1 --2- 172.21.15.3:0/3498134066 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f85ec0682f0 0x7f85ec06a7a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.494+0000 7f86106a5700 1 --2- 172.21.15.3:0/3498134066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f860806ea70 0x7f860814e800 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.494+0000 7f86106a5700 1 --2- 172.21.15.3:0/3498134066 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86080bdd60 0x7f86081373a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.494+0000 7f86106a5700 1 --2- 172.21.15.3:0/3498134066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f860806ee40 0x7f8608136e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.494+0000 7f86106a5700 1 -- 172.21.15.3:0/3498134066 >> 172.21.15.3:0/3498134066 conn(0x7f86080c2150 msgr2=0x7f86080c02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:54.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.494+0000 7f86106a5700 1 -- 172.21.15.3:0/3498134066 shutdown_connections 2023-03-06T14:15:54.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.494+0000 7f86106a5700 1 -- 172.21.15.3:0/3498134066 wait complete. 2023-03-06T14:15:54.498 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 3 2023-03-06T14:15:54.509 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T14:15:54.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.631+0000 7f9d8a9fd700 1 Processor -- start 2023-03-06T14:15:54.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.631+0000 7f9d8a9fd700 1 -- start start 2023-03-06T14:15:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.631+0000 7f9d8a9fd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9d840bdd60 0x7f9d840bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.631+0000 7f9d8a9fd700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8414ff80 con 0x7f9d8406ea70 2023-03-06T14:15:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.631+0000 7f9d8a9fd700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d840bcb90 con 0x7f9d8406ee40 2023-03-06T14:15:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.631+0000 7f9d8a9fd700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d840b9070 con 0x7f9d840bdd60 2023-03-06T14:15:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.632+0000 7f9d83fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f9d8406ea70 0x7f9d841490f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57674/0 (socket says 172.21.15.3:57674) 2023-03-06T14:15:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.632+0000 7f9d83fff700 1 -- 172.21.15.3:0/88081215 learned_addr learned my addr 172.21.15.3:0/88081215 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:15:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.632+0000 7f9d88f9a700 1 --2- 172.21.15.3:0/88081215 >> v2:172.21.15.136:3300/0 conn(0x7f9d840bdd60 0x7f9d840bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.632+0000 7f9d82ffd700 1 -- 172.21.15.3:0/88081215 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660415267 0 0) 0x7f9d8414ff80 con 0x7f9d8406ea70 2023-03-06T14:15:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.632+0000 7f9d82ffd700 1 -- 172.21.15.3:0/88081215 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d6c0035b0 con 0x7f9d8406ea70 2023-03-06T14:15:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.632+0000 7f9d88f9a700 1 -- 172.21.15.3:0/88081215 >> v1:172.21.15.136:6789/0 conn(0x7f9d8406ee40 legacy=0x7f9d8406c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.632+0000 7f9d82ffd700 1 -- 172.21.15.3:0/88081215 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560076490 0 0) 0x7f9d840bcb90 con 0x7f9d8406ee40 2023-03-06T14:15:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.632+0000 7f9d88f9a700 1 -- 172.21.15.3:0/88081215 >> v1:172.21.15.3:6789/0 conn(0x7f9d8406ea70 legacy=0x7f9d841490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.632+0000 7f9d88f9a700 1 -- 172.21.15.3:0/88081215 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d840bce70 con 0x7f9d840bdd60 2023-03-06T14:15:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.632+0000 7f9d88f9a700 1 --2- 172.21.15.3:0/88081215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d840bdd60 0x7f9d840bd670 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009d90 tx=0x7f9d7c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9202d468a7854105 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:54.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.632+0000 7f9d82ffd700 1 -- 172.21.15.3:0/88081215 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c00e070 con 0x7f9d840bdd60 2023-03-06T14:15:54.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.633+0000 7f9d82ffd700 1 -- 172.21.15.3:0/88081215 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c00bb20 con 0x7f9d840bdd60 2023-03-06T14:15:54.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.633+0000 7f9d82ffd700 1 -- 172.21.15.3:0/88081215 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c00bed0 con 0x7f9d840bdd60 2023-03-06T14:15:54.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.633+0000 7f9d8a9fd700 1 -- 172.21.15.3:0/88081215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d840bdd60 msgr2=0x7f9d840bd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:54.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.633+0000 7f9d8a9fd700 1 --2- 172.21.15.3:0/88081215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d840bdd60 0x7f9d840bd670 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009d90 tx=0x7f9d7c00b330 comp rx=0 tx=0).stop 2023-03-06T14:15:54.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.633+0000 7f9d8a9fd700 1 -- 172.21.15.3:0/88081215 shutdown_connections 2023-03-06T14:15:54.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.633+0000 7f9d8a9fd700 1 --2- 172.21.15.3:0/88081215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d840bdd60 0x7f9d840bd670 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.633+0000 7f9d8a9fd700 1 -- 172.21.15.3:0/88081215 >> 172.21.15.3:0/88081215 conn(0x7f9d840c2150 msgr2=0x7f9d840c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.633+0000 7f9d8a9fd700 1 -- 172.21.15.3:0/88081215 shutdown_connections 2023-03-06T14:15:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.633+0000 7f9d8a9fd700 1 -- 172.21.15.3:0/88081215 wait complete. 2023-03-06T14:15:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.634+0000 7f9d8a9fd700 1 Processor -- start 2023-03-06T14:15:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.634+0000 7f9d8a9fd700 1 -- start start 2023-03-06T14:15:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.635+0000 7f9d8a9fd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d8406ea70 0x7f9d840b97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.635+0000 7f9d8a9fd700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d8406ee40 0x7f9d840a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.635+0000 7f9d8a9fd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d840bdd60 0x7f9d840bb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:54.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.635+0000 7f9d8a9fd700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d84152310 con 0x7f9d840bdd60 2023-03-06T14:15:54.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.635+0000 7f9d8a9fd700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840b9d20 con 0x7f9d8406ea70 2023-03-06T14:15:54.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.635+0000 7f9d8a9fd700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d841e8860 con 0x7f9d8406ee40 2023-03-06T14:15:54.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.635+0000 7f9d88f9a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d840bdd60 0x7f9d840bb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:54.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.635+0000 7f9d88f9a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d840bdd60 0x7f9d840bb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55410/0 (socket says 172.21.15.3:55410) 2023-03-06T14:15:54.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.635+0000 7f9d88f9a700 1 -- 172.21.15.3:0/2707827598 learned_addr learned my addr 172.21.15.3:0/2707827598 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:54.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.635+0000 7f9d83fff700 1 --2- 172.21.15.3:0/2707827598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d8406ea70 0x7f9d840b97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:54.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.635+0000 7f9d837fe700 1 --2- 172.21.15.3:0/2707827598 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d8406ee40 0x7f9d840a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:54.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.635+0000 7f9d88f9a700 1 -- 172.21.15.3:0/2707827598 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d8406ee40 msgr2=0x7f9d840a5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:54.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.635+0000 7f9d88f9a700 1 --2- 172.21.15.3:0/2707827598 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d8406ee40 0x7f9d840a5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.635+0000 7f9d88f9a700 1 -- 172.21.15.3:0/2707827598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d8406ea70 msgr2=0x7f9d840b97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:54.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.635+0000 7f9d88f9a700 1 --2- 172.21.15.3:0/2707827598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d8406ea70 0x7f9d840b97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.635+0000 7f9d88f9a700 1 -- 172.21.15.3:0/2707827598 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c009a70 con 0x7f9d840bdd60 2023-03-06T14:15:54.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.635+0000 7f9d837fe700 1 --2- 172.21.15.3:0/2707827598 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d8406ee40 0x7f9d840a5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:15:54.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.636+0000 7f9d88f9a700 1 --2- 172.21.15.3:0/2707827598 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d840bdd60 0x7f9d840bb8c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c014040 tx=0x7f9d7c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:54.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.636+0000 7f9d80ff9700 1 -- 172.21.15.3:0/2707827598 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c01b8d0 con 0x7f9d840bdd60 2023-03-06T14:15:54.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.636+0000 7f9d80ff9700 1 -- 172.21.15.3:0/2707827598 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c020070 con 0x7f9d840bdd60 2023-03-06T14:15:54.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.636+0000 7f9d8a9fd700 1 -- 172.21.15.3:0/2707827598 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d84150220 con 0x7f9d840bdd60 2023-03-06T14:15:54.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.636+0000 7f9d80ff9700 1 -- 172.21.15.3:0/2707827598 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c01bc70 con 0x7f9d840bdd60 2023-03-06T14:15:54.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.636+0000 7f9d8a9fd700 1 -- 172.21.15.3:0/2707827598 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d840bd150 con 0x7f9d840bdd60 2023-03-06T14:15:54.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.637+0000 7f9d8a9fd700 1 -- 172.21.15.3:0/2707827598 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d840b8b80 con 0x7f9d840bdd60 2023-03-06T14:15:54.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.637+0000 7f9d80ff9700 1 -- 172.21.15.3:0/2707827598 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9d7c02e070 con 0x7f9d840bdd60 2023-03-06T14:15:54.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.637+0000 7f9d80ff9700 1 --2- 172.21.15.3:0/2707827598 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f9d700682f0 0x7f9d7006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:54.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.638+0000 7f9d80ff9700 1 -- 172.21.15.3:0/2707827598 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9d7c022070 con 0x7f9d840bdd60 2023-03-06T14:15:54.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.638+0000 7f9d83fff700 1 --2- 172.21.15.3:0/2707827598 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f9d700682f0 0x7f9d7006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:54.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.638+0000 7f9d83fff700 1 --2- 172.21.15.3:0/2707827598 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f9d700682f0 0x7f9d7006a7a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9d74007fd0 tx=0x7f9d74009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:54.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.642+0000 7f9d80ff9700 1 -- 172.21.15.3:0/2707827598 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9d7c054600 con 0x7f9d840bdd60 2023-03-06T14:15:54.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.836+0000 7f9d8a9fd700 1 -- 172.21.15.3:0/2707827598 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d84151720 con 0x7f9d840bdd60 2023-03-06T14:15:54.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.837+0000 7f9d80ff9700 1 -- 172.21.15.3:0/2707827598 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14120 (secure 0 0 0) 0x7f9d7c02c090 con 0x7f9d840bdd60 2023-03-06T14:15:54.840 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:15:54.840 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"fsid":"9aae2361-5af0-49eb-8f99-e7f69834fedf","created":"2023-03-06T14:15:33.357348+0000","modified":"2023-03-06T14:15:54.024568+0000","last_up_change":"2023-03-06T14:15:44.374764+0000","last_in_change":"2023-03-06T14:15:35.866803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T14:15:45.023761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T14:15:51.830917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c92c9e49-8a23-48a5-87e5-51f184f73a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":96679},{"type":"v1","addr":"172.21.15.3:6809","nonce":96679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":96679},{"type":"v1","addr":"172.21.15.3:6811","nonce":96679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":96679},{"type":"v1","addr":"172.21.15.3:6818","nonce":96679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":96679},{"type":"v1","addr":"172.21.15.3:6814","nonce":96679}]},"public_addr":"172.21.15.3:6809/96679","cluster_addr":"172.21.15.3:6811/96679","heartbeat_back_addr":"172.21.15.3:6818/96679","heartbeat_front_addr":"172.21.15.3:6814/96679","state":["exists","up"]},{"osd":1,"uuid":"86ec9127-843f-4246-bfbe-e14ce3af7d17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":96681},{"type":"v1","addr":"172.21.15.3:6825","nonce":96681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":96681},{"type":"v1","addr":"172.21.15.3:6827","nonce":96681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":96681},{"type":"v1","addr":"172.21.15.3:6831","nonce":96681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":96681},{"type":"v1","addr":"172.21.15.3:6829","nonce":96681}]},"public_addr":"172.21.15.3:6825/96681","cluster_addr":"172.21.15.3:6827/96681","heartbeat_back_addr":"172.21.15.3:6831/96681","heartbeat_front_addr":"172.21.15.3:6829/96681","state":["exists","up"]},{"osd":2,"uuid":"67582de3-0f75-4cf0-84ca-e878986f99f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":96682},{"type":"v1","addr":"172.21.15.3:6815","nonce":96682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6817","nonce":96682},{"type":"v1","addr":"172.21.15.3:6819","nonce":96682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":96682},{"type":"v1","addr":"172.21.15.3:6823","nonce":96682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":96682},{"type":"v1","addr":"172.21.15.3:6821","nonce":96682}]},"public_addr":"172.21.15.3:6815/96682","cluster_addr":"172.21.15.3:6819/96682","heartbeat_back_addr":"172.21.15.3:6823/96682","heartbeat_front_addr":"172.21.15.3:6821/96682","state":["exists","up"]},{"osd":3,"uuid":"0fb8d708-4b38-4153-8a60-79741765d439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":96680},{"type":"v1","addr":"172.21.15.3:6801","nonce":96680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":96680},{"type":"v1","addr":"172.21.15.3:6803","nonce":96680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":96680},{"type":"v1","addr":"172.21.15.3:6807","nonce":96680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":96680},{"type":"v1","addr":"172.21.15.3:6805","nonce":96680}]},"public_addr":"172.21.15.3:6801/96680","cluster_addr":"172.21.15.3:6803/96680","heartbeat_back_addr":"172.21.15.3:6807/96680","heartbeat_front_addr":"172.21.15.3:6805/96680","state":["exists","up"]},{"osd":4,"uuid":"44eb9d99-975f-43a3-8bf4-213b2ba6dea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":96798},{"type":"v1","addr":"172.21.15.136:6822","nonce":96798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":96798},{"type":"v1","addr":"172.21.15.136:6826","nonce":96798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":96798},{"type":"v1","addr":"172.21.15.136:6831","nonce":96798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":96798},{"type":"v1","addr":"172.21.15.136:6829","nonce":96798}]},"public_addr":"172.21.15.136:6822/96798","cluster_addr":"172.21.15.136:6826/96798","heartbeat_back_addr":"172.21.15.136:6831/96798","heartbeat_front_addr":"172.21.15.136:6829/96798","state":["exists","up"]},{"osd":5,"uuid":"aff1a438-c444-4ebc-9806-d2d117878a2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":96796},{"type":"v1","addr":"172.21.15.136:6804","nonce":96796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":96796},{"type":"v1","addr":"172.21.15.136:6809","nonce":96796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":96796},{"type":"v1","addr":"172.21.15.136:6815","nonce":96796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":96796},{"type":"v1","addr":"172.21.15.136:6813","nonce":96796}]},"public_addr":"172.21.15.136:6804/96796","cluster_addr":"172.21.15.136:6809/96796","heartbeat_back_addr":"172.21.15.136:6815/96796","heartbeat_front_addr":"172.21.15.136:6813/96796","state":["exists","up"]},{"osd":6,"uuid":"89cc219c-f57b-43f4-8e54-76017dd4930d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":96797},{"type":"v1","addr":"172.21.15.136:6801","nonce":96797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6803","nonce":96797},{"type":"v1","addr":"172.21.15.136:6805","nonce":96797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":96797},{"type":"v1","addr":"172.21.15.136:6811","nonce":96797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":96797},{"type":"v1","addr":"172.21.15.136:6808","nonce":96797}]},"public_addr":"172.21.15.136:6801/96797","cluster_addr":"172.21.15.136:6805/96797","heartbeat_back_addr":"172.21.15.136:6811/96797","heartbeat_front_addr":"172.21.15.136:6808/96797","state":["exists","up"]},{"osd":7,"uuid":"a90e4c14-00de-4d1c-92ce-9f20df714e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":96819},{"type":"v1","addr":"172.21.15.136:6817","nonce":96819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":96819},{"type":"v1","addr":"172.21.15.136:6819","nonce":96819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":96819},{"type":"v1","addr":"172.21.15.136:6827","nonce":96819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":96819},{"type":"v1","addr":"172.21.15.136:6823","nonce":96819}]},"public_addr":"172.21.15.136:6817/96819","cluster_addr":"172.21.15.136:6819/96819","heartbeat_back_addr":"172.21.15.136:6827/96819","heartbeat_front_addr":"172.21.15.136:6823/96819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.093141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.034488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.128137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.097924+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.045441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.005820+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.039918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.082053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T14:15:54.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.839+0000 7f9d8a9fd700 1 -- 172.21.15.3:0/2707827598 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f9d700682f0 msgr2=0x7f9d7006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:54.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.839+0000 7f9d8a9fd700 1 --2- 172.21.15.3:0/2707827598 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f9d700682f0 0x7f9d7006a7a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9d74007fd0 tx=0x7f9d74009040 comp rx=0 tx=0).stop 2023-03-06T14:15:54.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.839+0000 7f9d8a9fd700 1 -- 172.21.15.3:0/2707827598 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d840bdd60 msgr2=0x7f9d840bb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:54.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.839+0000 7f9d8a9fd700 1 --2- 172.21.15.3:0/2707827598 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d840bdd60 0x7f9d840bb8c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c014040 tx=0x7f9d7c004ad0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.839+0000 7f9d8a9fd700 1 -- 172.21.15.3:0/2707827598 shutdown_connections 2023-03-06T14:15:54.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.839+0000 7f9d8a9fd700 1 --2- 172.21.15.3:0/2707827598 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f9d700682f0 0x7f9d7006a7a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.839+0000 7f9d8a9fd700 1 --2- 172.21.15.3:0/2707827598 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d840bdd60 0x7f9d840bb8c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.839+0000 7f9d8a9fd700 1 --2- 172.21.15.3:0/2707827598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d8406ea70 0x7f9d840b97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.839+0000 7f9d8a9fd700 1 --2- 172.21.15.3:0/2707827598 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d8406ee40 0x7f9d840a5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.839+0000 7f9d8a9fd700 1 -- 172.21.15.3:0/2707827598 >> 172.21.15.3:0/2707827598 conn(0x7f9d840c2150 msgr2=0x7f9d8406b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:54.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.840+0000 7f9d8a9fd700 1 -- 172.21.15.3:0/2707827598 shutdown_connections 2023-03-06T14:15:54.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.840+0000 7f9d8a9fd700 1 -- 172.21.15.3:0/2707827598 wait complete. 2023-03-06T14:15:54.854 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-06T14:15:45.023761+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-06T14:15:51.830917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-06T14:15:54.854 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-06T14:15:54.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.979+0000 7fcef236f700 1 Processor -- start 2023-03-06T14:15:54.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.979+0000 7fcef236f700 1 -- start start 2023-03-06T14:15:54.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.979+0000 7fcef236f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fceec06ee40 0x7fceec0bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:54.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.979+0000 7fcef236f700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fceec0bdd60 0x7fceec06c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:54.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.979+0000 7fcef236f700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceec14ff80 con 0x7fceec06ea70 2023-03-06T14:15:54.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.979+0000 7fcef236f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceec0b9070 con 0x7fceec06ee40 2023-03-06T14:15:54.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.979+0000 7fcef236f700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceec0bcb90 con 0x7fceec0bdd60 2023-03-06T14:15:54.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.980+0000 7fceeb7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fceec06ee40 0x7fceec0bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:54.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.980+0000 7fceeb7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fceec06ee40 0x7fceec0bd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55416/0 (socket says 172.21.15.3:55416) 2023-03-06T14:15:54.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.980+0000 7fceeb7fe700 1 -- 172.21.15.3:0/1864686108 learned_addr learned my addr 172.21.15.3:0/1864686108 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:54.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.980+0000 7fcef090c700 1 --2- 172.21.15.3:0/1864686108 >> v2:172.21.15.136:3300/0 conn(0x7fceec0bdd60 0x7fceec06c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:54.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.980+0000 7fceeb7fe700 1 -- 172.21.15.3:0/1864686108 >> v2:172.21.15.136:3300/0 conn(0x7fceec0bdd60 msgr2=0x7fceec06c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:54.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.980+0000 7fceeb7fe700 1 --2- 172.21.15.3:0/1864686108 >> v2:172.21.15.136:3300/0 conn(0x7fceec0bdd60 0x7fceec06c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.980+0000 7fceeb7fe700 1 -- 172.21.15.3:0/1864686108 >> v1:172.21.15.136:6789/0 conn(0x7fceec06ea70 legacy=0x7fceec1490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:54.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.980+0000 7fceeb7fe700 1 -- 172.21.15.3:0/1864686108 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec0bce70 con 0x7fceec06ee40 2023-03-06T14:15:54.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.980+0000 7fceeb7fe700 1 --2- 172.21.15.3:0/1864686108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fceec06ee40 0x7fceec0bd670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fceec153890 tx=0x7fcee0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3cd0ab145c05f5f server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:54.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.980+0000 7fceeaffd700 1 -- 172.21.15.3:0/1864686108 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee0004230 con 0x7fceec06ee40 2023-03-06T14:15:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.980+0000 7fceeaffd700 1 -- 172.21.15.3:0/1864686108 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee0004390 con 0x7fceec06ee40 2023-03-06T14:15:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.980+0000 7fceeaffd700 1 -- 172.21.15.3:0/1864686108 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee00036a0 con 0x7fceec06ee40 2023-03-06T14:15:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.981+0000 7fcef236f700 1 -- 172.21.15.3:0/1864686108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fceec06ee40 msgr2=0x7fceec0bd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.981+0000 7fcef236f700 1 --2- 172.21.15.3:0/1864686108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fceec06ee40 0x7fceec0bd670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fceec153890 tx=0x7fcee0009bd0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.981+0000 7fcef236f700 1 -- 172.21.15.3:0/1864686108 shutdown_connections 2023-03-06T14:15:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.981+0000 7fcef236f700 1 --2- 172.21.15.3:0/1864686108 >> v2:172.21.15.136:3300/0 conn(0x7fceec0bdd60 0x7fceec06c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.981+0000 7fcef236f700 1 --2- 172.21.15.3:0/1864686108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fceec06ee40 0x7fceec0bd670 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.981+0000 7fcef236f700 1 -- 172.21.15.3:0/1864686108 >> 172.21.15.3:0/1864686108 conn(0x7fceec0c2150 msgr2=0x7fceec0c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.981+0000 7fcef236f700 1 -- 172.21.15.3:0/1864686108 shutdown_connections 2023-03-06T14:15:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.981+0000 7fcef236f700 1 -- 172.21.15.3:0/1864686108 wait complete. 2023-03-06T14:15:54.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.982+0000 7fcef236f700 1 Processor -- start 2023-03-06T14:15:54.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.982+0000 7fcef236f700 1 -- start start 2023-03-06T14:15:54.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.983+0000 7fcef236f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fceec06ea70 0x7fceec1e7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:54.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.983+0000 7fcef236f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fceec06ee40 0x7fceec151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:54.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.983+0000 7fcef236f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fceec0bdd60 0x7fceec1521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:54.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.983+0000 7fcef236f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec152a20 con 0x7fceec06ea70 2023-03-06T14:15:54.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.983+0000 7fcef236f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec1e8920 con 0x7fceec06ee40 2023-03-06T14:15:54.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.983+0000 7fcef236f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec151820 con 0x7fceec0bdd60 2023-03-06T14:15:54.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.983+0000 7fceebfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fceec06ea70 0x7fceec1e7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:54.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.983+0000 7fceebfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fceec06ea70 0x7fceec1e7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55420/0 (socket says 172.21.15.3:55420) 2023-03-06T14:15:54.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.983+0000 7fceebfff700 1 -- 172.21.15.3:0/4068001035 learned_addr learned my addr 172.21.15.3:0/4068001035 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:54.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.983+0000 7fceeb7fe700 1 --2- 172.21.15.3:0/4068001035 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fceec06ee40 0x7fceec151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:54.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.983+0000 7fcef090c700 1 --2- 172.21.15.3:0/4068001035 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fceec0bdd60 0x7fceec1521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:54.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.983+0000 7fceebfff700 1 -- 172.21.15.3:0/4068001035 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fceec0bdd60 msgr2=0x7fceec1521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:54.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.983+0000 7fceebfff700 1 --2- 172.21.15.3:0/4068001035 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fceec0bdd60 0x7fceec1521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.983+0000 7fceebfff700 1 -- 172.21.15.3:0/4068001035 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fceec06ee40 msgr2=0x7fceec151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.983+0000 7fceebfff700 1 --2- 172.21.15.3:0/4068001035 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fceec06ee40 0x7fceec151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.983+0000 7fceebfff700 1 -- 172.21.15.3:0/4068001035 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee0009550 con 0x7fceec06ea70 2023-03-06T14:15:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.983+0000 7fceebfff700 1 --2- 172.21.15.3:0/4068001035 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fceec06ea70 0x7fceec1e7c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcedc00b480 tx=0x7fcedc00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.983+0000 7fcee8ff9700 1 -- 172.21.15.3:0/4068001035 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc00be50 con 0x7fceec06ea70 2023-03-06T14:15:54.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.984+0000 7fcee8ff9700 1 -- 172.21.15.3:0/4068001035 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc004020 con 0x7fceec06ea70 2023-03-06T14:15:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.984+0000 7fcef236f700 1 -- 172.21.15.3:0/4068001035 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceec150220 con 0x7fceec06ea70 2023-03-06T14:15:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.984+0000 7fcee8ff9700 1 -- 172.21.15.3:0/4068001035 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0043d0 con 0x7fceec06ea70 2023-03-06T14:15:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.984+0000 7fcef236f700 1 -- 172.21.15.3:0/4068001035 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceec0bd150 con 0x7fceec06ea70 2023-03-06T14:15:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.984+0000 7fcef236f700 1 -- 172.21.15.3:0/4068001035 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceec151b00 con 0x7fceec06ea70 2023-03-06T14:15:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.985+0000 7fcee8ff9700 1 -- 172.21.15.3:0/4068001035 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fcedc00f050 con 0x7fceec06ea70 2023-03-06T14:15:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.985+0000 7fcee8ff9700 1 --2- 172.21.15.3:0/4068001035 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fced80682f0 0x7fced806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.985+0000 7fcee8ff9700 1 -- 172.21.15.3:0/4068001035 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcedc0852f0 con 0x7fceec06ea70 2023-03-06T14:15:54.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.986+0000 7fceeb7fe700 1 --2- 172.21.15.3:0/4068001035 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fced80682f0 0x7fced806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:54.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.986+0000 7fceeb7fe700 1 --2- 172.21.15.3:0/4068001035 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fced80682f0 0x7fced806a7a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcee0009130 tx=0x7fcee0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:54.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:54.990+0000 7fcee8ff9700 1 -- 172.21.15.3:0/4068001035 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fcedc051ea0 con 0x7fceec06ea70 2023-03-06T14:15:55.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.184+0000 7fcef236f700 1 -- 172.21.15.3:0/4068001035 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fceec06faf0 con 0x7fceec06ea70 2023-03-06T14:15:55.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.184+0000 7fcee8ff9700 1 -- 172.21.15.3:0/4068001035 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcedc015020 con 0x7fceec06ea70 2023-03-06T14:15:55.187 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-03-06T14:15:55.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.187+0000 7fcef236f700 1 -- 172.21.15.3:0/4068001035 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fced80682f0 msgr2=0x7fced806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:55.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.187+0000 7fcef236f700 1 --2- 172.21.15.3:0/4068001035 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fced80682f0 0x7fced806a7a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcee0009130 tx=0x7fcee0008030 comp rx=0 tx=0).stop 2023-03-06T14:15:55.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.187+0000 7fcef236f700 1 -- 172.21.15.3:0/4068001035 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fceec06ea70 msgr2=0x7fceec1e7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:55.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.187+0000 7fcef236f700 1 --2- 172.21.15.3:0/4068001035 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fceec06ea70 0x7fceec1e7c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcedc00b480 tx=0x7fcedc00b790 comp rx=0 tx=0).stop 2023-03-06T14:15:55.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.187+0000 7fcef236f700 1 -- 172.21.15.3:0/4068001035 shutdown_connections 2023-03-06T14:15:55.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.187+0000 7fcef236f700 1 --2- 172.21.15.3:0/4068001035 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fced80682f0 0x7fced806a7a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.187+0000 7fcef236f700 1 --2- 172.21.15.3:0/4068001035 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fceec06ea70 0x7fceec1e7c50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.187+0000 7fcef236f700 1 --2- 172.21.15.3:0/4068001035 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fceec0bdd60 0x7fceec1521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.187+0000 7fcef236f700 1 --2- 172.21.15.3:0/4068001035 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fceec06ee40 0x7fceec151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.187+0000 7fcef236f700 1 -- 172.21.15.3:0/4068001035 >> 172.21.15.3:0/4068001035 conn(0x7fceec0c2150 msgr2=0x7fceec0a51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:55.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.187+0000 7fcef236f700 1 -- 172.21.15.3:0/4068001035 shutdown_connections 2023-03-06T14:15:55.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.187+0000 7fcef236f700 1 -- 172.21.15.3:0/4068001035 wait complete. 2023-03-06T14:15:55.201 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-06T14:15:55.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.326+0000 7fab76973700 1 Processor -- start 2023-03-06T14:15:55.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.326+0000 7fab76973700 1 -- start start 2023-03-06T14:15:55.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.327+0000 7fab76973700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fab7006ea70 0x7fab700bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:55.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.327+0000 7fab76973700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fab7006ee40 0x7fab701490f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:55.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.327+0000 7fab76973700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab700bdd60 0x7fab70149630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:55.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.327+0000 7fab76973700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab700b9070 con 0x7fab7006ea70 2023-03-06T14:15:55.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.327+0000 7fab76973700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab70149b70 con 0x7fab7006ee40 2023-03-06T14:15:55.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.327+0000 7fab76973700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7014ff80 con 0x7fab700bdd60 2023-03-06T14:15:55.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.327+0000 7fab6ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fab7006ea70 0x7fab700bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:55.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.327+0000 7fab6ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fab7006ea70 0x7fab700bd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55428/0 (socket says 172.21.15.3:55428) 2023-03-06T14:15:55.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.327+0000 7fab6ffff700 1 -- 172.21.15.3:0/303213381 learned_addr learned my addr 172.21.15.3:0/303213381 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:55.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab74f10700 1 --2- 172.21.15.3:0/303213381 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab700bdd60 0x7fab70149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:55.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab6f7fe700 1 --2- 172.21.15.3:0/303213381 >> v2:172.21.15.136:3300/0 conn(0x7fab7006ee40 0x7fab701490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:55.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab6ffff700 1 -- 172.21.15.3:0/303213381 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab700bdd60 msgr2=0x7fab70149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:55.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab6ffff700 1 --2- 172.21.15.3:0/303213381 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab700bdd60 0x7fab70149630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab6ffff700 1 -- 172.21.15.3:0/303213381 >> v2:172.21.15.136:3300/0 conn(0x7fab7006ee40 msgr2=0x7fab701490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:55.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab6ffff700 1 --2- 172.21.15.3:0/303213381 >> v2:172.21.15.136:3300/0 conn(0x7fab7006ee40 0x7fab701490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab6ffff700 1 -- 172.21.15.3:0/303213381 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab700bcb90 con 0x7fab7006ea70 2023-03-06T14:15:55.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab74f10700 1 --2- 172.21.15.3:0/303213381 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab700bdd60 0x7fab70149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:15:55.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab6f7fe700 1 --2- 172.21.15.3:0/303213381 >> v2:172.21.15.136:3300/0 conn(0x7fab7006ee40 0x7fab701490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:15:55.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab6ffff700 1 --2- 172.21.15.3:0/303213381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab7006ea70 0x7fab700bd670 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fab700726c0 tx=0x7fab60009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987bced16ea16503 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:55.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab6effd700 1 -- 172.21.15.3:0/303213381 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab60005e30 con 0x7fab7006ea70 2023-03-06T14:15:55.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab6effd700 1 -- 172.21.15.3:0/303213381 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab60004030 con 0x7fab7006ea70 2023-03-06T14:15:55.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab6effd700 1 -- 172.21.15.3:0/303213381 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab600043e0 con 0x7fab7006ea70 2023-03-06T14:15:55.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab76973700 1 -- 172.21.15.3:0/303213381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab7006ea70 msgr2=0x7fab700bd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:55.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab76973700 1 --2- 172.21.15.3:0/303213381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab7006ea70 0x7fab700bd670 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fab700726c0 tx=0x7fab60009bd0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab76973700 1 -- 172.21.15.3:0/303213381 shutdown_connections 2023-03-06T14:15:55.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab76973700 1 --2- 172.21.15.3:0/303213381 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab700bdd60 0x7fab70149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab76973700 1 --2- 172.21.15.3:0/303213381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab7006ea70 0x7fab700bd670 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab76973700 1 --2- 172.21.15.3:0/303213381 >> v2:172.21.15.136:3300/0 conn(0x7fab7006ee40 0x7fab701490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab76973700 1 -- 172.21.15.3:0/303213381 >> 172.21.15.3:0/303213381 conn(0x7fab700c2150 msgr2=0x7fab700c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:55.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.328+0000 7fab76973700 1 -- 172.21.15.3:0/303213381 shutdown_connections 2023-03-06T14:15:55.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.329+0000 7fab76973700 1 -- 172.21.15.3:0/303213381 wait complete. 2023-03-06T14:15:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.330+0000 7fab76973700 1 Processor -- start 2023-03-06T14:15:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.330+0000 7fab76973700 1 -- start start 2023-03-06T14:15:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.330+0000 7fab76973700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab7006ea70 0x7fab7014e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.330+0000 7fab76973700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab7006ee40 0x7fab701e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.330+0000 7fab76973700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab700bdd60 0x7fab70143330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.330+0000 7fab76973700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab701e46d0 con 0x7fab7006ea70 2023-03-06T14:15:55.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.330+0000 7fab76973700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7014ed70 con 0x7fab7006ee40 2023-03-06T14:15:55.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.330+0000 7fab76973700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab701e48c0 con 0x7fab700bdd60 2023-03-06T14:15:55.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.331+0000 7fab6ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab7006ea70 0x7fab7014e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:55.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.331+0000 7fab6ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab7006ea70 0x7fab7014e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55434/0 (socket says 172.21.15.3:55434) 2023-03-06T14:15:55.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.331+0000 7fab6ffff700 1 -- 172.21.15.3:0/892922485 learned_addr learned my addr 172.21.15.3:0/892922485 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:55.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.331+0000 7fab6f7fe700 1 --2- 172.21.15.3:0/892922485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab7006ee40 0x7fab701e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:55.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.331+0000 7fab74f10700 1 --2- 172.21.15.3:0/892922485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab700bdd60 0x7fab70143330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:55.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.331+0000 7fab6ffff700 1 -- 172.21.15.3:0/892922485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab700bdd60 msgr2=0x7fab70143330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:55.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.331+0000 7fab6ffff700 1 --2- 172.21.15.3:0/892922485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab700bdd60 0x7fab70143330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.331+0000 7fab6ffff700 1 -- 172.21.15.3:0/892922485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab7006ee40 msgr2=0x7fab701e50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:55.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.331+0000 7fab6ffff700 1 --2- 172.21.15.3:0/892922485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab7006ee40 0x7fab701e50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.331+0000 7fab6ffff700 1 -- 172.21.15.3:0/892922485 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab60009500 con 0x7fab7006ea70 2023-03-06T14:15:55.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.331+0000 7fab74f10700 1 --2- 172.21.15.3:0/892922485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab700bdd60 0x7fab70143330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:15:55.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.331+0000 7fab6ffff700 1 --2- 172.21.15.3:0/892922485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab7006ea70 0x7fab7014e830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fab60009c10 tx=0x7fab60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:55.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.331+0000 7fab6cff9700 1 -- 172.21.15.3:0/892922485 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab60011620 con 0x7fab7006ea70 2023-03-06T14:15:55.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.331+0000 7fab6cff9700 1 -- 172.21.15.3:0/892922485 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab60011780 con 0x7fab7006ea70 2023-03-06T14:15:55.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.331+0000 7fab76973700 1 -- 172.21.15.3:0/892922485 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab700bd150 con 0x7fab7006ea70 2023-03-06T14:15:55.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.331+0000 7fab6cff9700 1 -- 172.21.15.3:0/892922485 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab60011b10 con 0x7fab7006ea70 2023-03-06T14:15:55.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.331+0000 7fab76973700 1 -- 172.21.15.3:0/892922485 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab700bce70 con 0x7fab7006ea70 2023-03-06T14:15:55.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.332+0000 7fab76973700 1 -- 172.21.15.3:0/892922485 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab70150220 con 0x7fab7006ea70 2023-03-06T14:15:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.332+0000 7fab6cff9700 1 -- 172.21.15.3:0/892922485 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fab6002b070 con 0x7fab7006ea70 2023-03-06T14:15:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.333+0000 7fab6cff9700 1 --2- 172.21.15.3:0/892922485 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fab5c0682f0 0x7fab5c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.333+0000 7fab6cff9700 1 -- 172.21.15.3:0/892922485 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fab60086880 con 0x7fab7006ea70 2023-03-06T14:15:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.333+0000 7fab6f7fe700 1 --2- 172.21.15.3:0/892922485 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fab5c0682f0 0x7fab5c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.333+0000 7fab6f7fe700 1 --2- 172.21.15.3:0/892922485 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fab5c0682f0 0x7fab5c06a7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fab7014f3f0 tx=0x7fab64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.337+0000 7fab6cff9700 1 -- 172.21.15.3:0/892922485 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fab60053430 con 0x7fab7006ea70 2023-03-06T14:15:55.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.531+0000 7fab76973700 1 -- 172.21.15.3:0/892922485 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fab700b8070 con 0x7fab7006ea70 2023-03-06T14:15:55.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.531+0000 7fab6cff9700 1 -- 172.21.15.3:0/892922485 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fab600290a0 con 0x7fab7006ea70 2023-03-06T14:15:55.534 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-03-06T14:15:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.533+0000 7fab76973700 1 -- 172.21.15.3:0/892922485 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fab5c0682f0 msgr2=0x7fab5c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:55.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.533+0000 7fab76973700 1 --2- 172.21.15.3:0/892922485 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fab5c0682f0 0x7fab5c06a7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fab7014f3f0 tx=0x7fab64008040 comp rx=0 tx=0).stop 2023-03-06T14:15:55.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.533+0000 7fab76973700 1 -- 172.21.15.3:0/892922485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab7006ea70 msgr2=0x7fab7014e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:55.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.533+0000 7fab76973700 1 --2- 172.21.15.3:0/892922485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab7006ea70 0x7fab7014e830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fab60009c10 tx=0x7fab60004750 comp rx=0 tx=0).stop 2023-03-06T14:15:55.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.533+0000 7fab76973700 1 -- 172.21.15.3:0/892922485 shutdown_connections 2023-03-06T14:15:55.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.533+0000 7fab76973700 1 --2- 172.21.15.3:0/892922485 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fab5c0682f0 0x7fab5c06a7a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.533+0000 7fab76973700 1 --2- 172.21.15.3:0/892922485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab7006ea70 0x7fab7014e830 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.533+0000 7fab76973700 1 --2- 172.21.15.3:0/892922485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab700bdd60 0x7fab70143330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.533+0000 7fab76973700 1 --2- 172.21.15.3:0/892922485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab7006ee40 0x7fab701e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.533+0000 7fab76973700 1 -- 172.21.15.3:0/892922485 >> 172.21.15.3:0/892922485 conn(0x7fab700c2150 msgr2=0x7fab700b8590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:55.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.533+0000 7fab76973700 1 -- 172.21.15.3:0/892922485 shutdown_connections 2023-03-06T14:15:55.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.533+0000 7fab76973700 1 -- 172.21.15.3:0/892922485 wait complete. 2023-03-06T14:15:55.547 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-03-06T14:15:55.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.668+0000 7fbfa8bda700 1 Processor -- start 2023-03-06T14:15:55.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.669+0000 7fbfa8bda700 1 -- start start 2023-03-06T14:15:55.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.669+0000 7fbfa8bda700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbfa406ea70 0x7fbfa40bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:55.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.669+0000 7fbfa8bda700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbfa406ee40 0x7fbfa41490f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:55.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.669+0000 7fbfa8bda700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa414ff80 con 0x7fbfa40bdd60 2023-03-06T14:15:55.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.669+0000 7fbfa8bda700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa40b9070 con 0x7fbfa406ee40 2023-03-06T14:15:55.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.669+0000 7fbfa8bda700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa40bcb90 con 0x7fbfa406ea70 2023-03-06T14:15:55.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa2d9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fbfa40bdd60 0x7fbfa406c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57718/0 (socket says 172.21.15.3:57718) 2023-03-06T14:15:55.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa2d9d700 1 -- 172.21.15.3:0/4181450454 learned_addr learned my addr 172.21.15.3:0/4181450454 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:15:55.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa1d9b700 1 --2- 172.21.15.3:0/4181450454 >> v2:172.21.15.136:3300/0 conn(0x7fbfa406ee40 0x7fbfa41490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:55.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa259c700 1 --2- 172.21.15.3:0/4181450454 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbfa406ea70 0x7fbfa40bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:55.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa159a700 1 -- 172.21.15.3:0/4181450454 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563526641 0 0) 0x7fbfa414ff80 con 0x7fbfa40bdd60 2023-03-06T14:15:55.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa159a700 1 -- 172.21.15.3:0/4181450454 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf8c0035b0 con 0x7fbfa40bdd60 2023-03-06T14:15:55.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa159a700 1 -- 172.21.15.3:0/4181450454 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3622646174 0 0) 0x7fbf8c0035b0 con 0x7fbfa40bdd60 2023-03-06T14:15:55.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa159a700 1 -- 172.21.15.3:0/4181450454 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbfa406ea70 msgr2=0x7fbfa40bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:55.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa159a700 1 --2- 172.21.15.3:0/4181450454 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbfa406ea70 0x7fbfa40bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa159a700 1 -- 172.21.15.3:0/4181450454 >> v2:172.21.15.136:3300/0 conn(0x7fbfa406ee40 msgr2=0x7fbfa41490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:55.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa159a700 1 --2- 172.21.15.3:0/4181450454 >> v2:172.21.15.136:3300/0 conn(0x7fbfa406ee40 0x7fbfa41490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa159a700 1 -- 172.21.15.3:0/4181450454 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa40bce70 con 0x7fbfa40bdd60 2023-03-06T14:15:55.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa159a700 1 -- 172.21.15.3:0/4181450454 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3255535284 0 0) 0x7fbf9c0019f0 con 0x7fbfa40bdd60 2023-03-06T14:15:55.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa159a700 1 -- 172.21.15.3:0/4181450454 >> v1:172.21.15.3:6789/0 conn(0x7fbfa40bdd60 legacy=0x7fbfa406c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:55.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa159a700 1 --2- 172.21.15.3:0/4181450454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf8c003a00 0x7fbf8c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:55.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa159a700 1 --2- 172.21.15.3:0/4181450454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf8c004430 0x7fbf8c0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:55.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa159a700 1 --2- 172.21.15.3:0/4181450454 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbfa406ea70 0x7fbf8c004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:55.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa159a700 1 -- 172.21.15.3:0/4181450454 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa40bcb90 con 0x7fbf8c004430 2023-03-06T14:15:55.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa159a700 1 -- 172.21.15.3:0/4181450454 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c005700 con 0x7fbf8c003a00 2023-03-06T14:15:55.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa159a700 1 -- 172.21.15.3:0/4181450454 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c00ba90 con 0x7fbfa406ea70 2023-03-06T14:15:55.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa1d9b700 1 --2- 172.21.15.3:0/4181450454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf8c004430 0x7fbf8c0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:55.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa259c700 1 --2- 172.21.15.3:0/4181450454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf8c003a00 0x7fbf8c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:55.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.670+0000 7fbfa2d9d700 1 --2- 172.21.15.3:0/4181450454 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbfa406ea70 0x7fbf8c004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:55.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.671+0000 7fbfa1d9b700 1 -- 172.21.15.3:0/4181450454 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbfa406ea70 msgr2=0x7fbf8c004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:55.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.671+0000 7fbfa1d9b700 1 --2- 172.21.15.3:0/4181450454 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbfa406ea70 0x7fbf8c004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.671+0000 7fbfa1d9b700 1 -- 172.21.15.3:0/4181450454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf8c003a00 msgr2=0x7fbf8c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:55.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.671+0000 7fbfa1d9b700 1 --2- 172.21.15.3:0/4181450454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf8c003a00 0x7fbf8c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.671+0000 7fbfa1d9b700 1 -- 172.21.15.3:0/4181450454 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c0035b0 con 0x7fbf8c004430 2023-03-06T14:15:55.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.671+0000 7fbfa1d9b700 1 --2- 172.21.15.3:0/4181450454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf8c004430 0x7fbf8c0048f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbf94009b60 tx=0x7fbf8c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666c500e884840ff server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:55.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.671+0000 7fbfa159a700 1 -- 172.21.15.3:0/4181450454 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9400e6c0 con 0x7fbf8c004430 2023-03-06T14:15:55.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.671+0000 7fbfa159a700 1 -- 172.21.15.3:0/4181450454 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9400e820 con 0x7fbf8c004430 2023-03-06T14:15:55.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.671+0000 7fbfa159a700 1 -- 172.21.15.3:0/4181450454 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9400eb90 con 0x7fbf8c004430 2023-03-06T14:15:55.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.671+0000 7fbfa8bda700 1 -- 172.21.15.3:0/4181450454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf8c004430 msgr2=0x7fbf8c0048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:55.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.671+0000 7fbfa8bda700 1 --2- 172.21.15.3:0/4181450454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf8c004430 0x7fbf8c0048f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbf94009b60 tx=0x7fbf8c005880 comp rx=0 tx=0).stop 2023-03-06T14:15:55.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.671+0000 7fbfa2d9d700 1 -- 172.21.15.3:0/4181450454 reap_dead start 2023-03-06T14:15:55.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.671+0000 7fbfa8bda700 1 -- 172.21.15.3:0/4181450454 shutdown_connections 2023-03-06T14:15:55.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.671+0000 7fbfa8bda700 1 -- 172.21.15.3:0/4181450454 >> 172.21.15.3:0/4181450454 conn(0x7fbfa40c2150 msgr2=0x7fbfa40c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:55.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.671+0000 7fbfa8bda700 1 -- 172.21.15.3:0/4181450454 shutdown_connections 2023-03-06T14:15:55.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.671+0000 7fbfa8bda700 1 -- 172.21.15.3:0/4181450454 wait complete. 2023-03-06T14:15:55.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.673+0000 7fbfa8bda700 1 Processor -- start 2023-03-06T14:15:55.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.673+0000 7fbfa8bda700 1 -- start start 2023-03-06T14:15:55.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.673+0000 7fbfa8bda700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbf8c004430 0x7fbfa40a6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:55.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.673+0000 7fbfa8bda700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbfa40a6cd0 0x7fbfa41e7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:55.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.673+0000 7fbfa8bda700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa41e7ff0 0x7fbfa40ba430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:55.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.673+0000 7fbfa8bda700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa41e89f0 con 0x7fbfa40a6cd0 2023-03-06T14:15:55.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.673+0000 7fbfa8bda700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa40a7140 con 0x7fbfa41e7ff0 2023-03-06T14:15:55.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.673+0000 7fbfa8bda700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa41e8440 con 0x7fbf8c004430 2023-03-06T14:15:55.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.673+0000 7fbfa1d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbfa40a6cd0 0x7fbfa41e7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:55.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.674+0000 7fbfa1d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbfa40a6cd0 0x7fbfa41e7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55454/0 (socket says 172.21.15.3:55454) 2023-03-06T14:15:55.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.674+0000 7fbfa1d9b700 1 -- 172.21.15.3:0/3156745348 learned_addr learned my addr 172.21.15.3:0/3156745348 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:55.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.674+0000 7fbfa259c700 1 --2- 172.21.15.3:0/3156745348 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbf8c004430 0x7fbfa40a6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:55.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.674+0000 7fbfa2d9d700 1 --2- 172.21.15.3:0/3156745348 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa41e7ff0 0x7fbfa40ba430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:55.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.674+0000 7fbfa1d9b700 1 -- 172.21.15.3:0/3156745348 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbf8c004430 msgr2=0x7fbfa40a6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:55.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.674+0000 7fbfa1d9b700 1 --2- 172.21.15.3:0/3156745348 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbf8c004430 0x7fbfa40a6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.674+0000 7fbfa1d9b700 1 -- 172.21.15.3:0/3156745348 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa41e7ff0 msgr2=0x7fbfa40ba430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:55.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.674+0000 7fbfa1d9b700 1 --2- 172.21.15.3:0/3156745348 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa41e7ff0 0x7fbfa40ba430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.674+0000 7fbfa1d9b700 1 -- 172.21.15.3:0/3156745348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa4150220 con 0x7fbfa40a6cd0 2023-03-06T14:15:55.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.674+0000 7fbfa1d9b700 1 --2- 172.21.15.3:0/3156745348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbfa40a6cd0 0x7fbfa41e7ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c0056d0 tx=0x7fbf940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:55.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.674+0000 7fbf92ffd700 1 -- 172.21.15.3:0/3156745348 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9400e6c0 con 0x7fbfa40a6cd0 2023-03-06T14:15:55.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.674+0000 7fbf92ffd700 1 -- 172.21.15.3:0/3156745348 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf94003ab0 con 0x7fbfa40a6cd0 2023-03-06T14:15:55.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.674+0000 7fbfa8bda700 1 -- 172.21.15.3:0/3156745348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa40bd150 con 0x7fbfa40a6cd0 2023-03-06T14:15:55.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.674+0000 7fbf92ffd700 1 -- 172.21.15.3:0/3156745348 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf94003e60 con 0x7fbfa40a6cd0 2023-03-06T14:15:55.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.674+0000 7fbfa8bda700 1 -- 172.21.15.3:0/3156745348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa40b8b80 con 0x7fbfa40a6cd0 2023-03-06T14:15:55.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.675+0000 7fbfa8bda700 1 -- 172.21.15.3:0/3156745348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa40a6400 con 0x7fbfa40a6cd0 2023-03-06T14:15:55.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.676+0000 7fbf92ffd700 1 -- 172.21.15.3:0/3156745348 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbf94019030 con 0x7fbfa40a6cd0 2023-03-06T14:15:55.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.676+0000 7fbf92ffd700 1 --2- 172.21.15.3:0/3156745348 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fbf840682f0 0x7fbf8406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:55.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.676+0000 7fbf92ffd700 1 -- 172.21.15.3:0/3156745348 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbf94087000 con 0x7fbfa40a6cd0 2023-03-06T14:15:55.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.676+0000 7fbfa259c700 1 --2- 172.21.15.3:0/3156745348 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fbf840682f0 0x7fbf8406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:55.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.677+0000 7fbfa259c700 1 --2- 172.21.15.3:0/3156745348 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fbf840682f0 0x7fbf8406a7a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009b60 tx=0x7fbf980091c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:55.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.680+0000 7fbf92ffd700 1 -- 172.21.15.3:0/3156745348 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbf94053bb0 con 0x7fbfa40a6cd0 2023-03-06T14:15:55.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.874+0000 7fbfa8bda700 1 -- 172.21.15.3:0/3156745348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbfa40c2930 con 0x7fbfa40a6cd0 2023-03-06T14:15:55.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.875+0000 7fbf92ffd700 1 -- 172.21.15.3:0/3156745348 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7fbf940571d0 con 0x7fbfa40a6cd0 2023-03-06T14:15:55.878 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:15:55.878 INFO:teuthology.orchestra.run.smithi003.stdout:[ 2023-03-06T14:15:55.878 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-03-06T14:15:55.878 INFO:teuthology.orchestra.run.smithi003.stdout: "poolnum": 1, 2023-03-06T14:15:55.879 INFO:teuthology.orchestra.run.smithi003.stdout: "poolname": ".mgr" 2023-03-06T14:15:55.879 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-03-06T14:15:55.879 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-03-06T14:15:55.879 INFO:teuthology.orchestra.run.smithi003.stdout: "poolnum": 2, 2023-03-06T14:15:55.879 INFO:teuthology.orchestra.run.smithi003.stdout: "poolname": "rbd" 2023-03-06T14:15:55.879 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-03-06T14:15:55.879 INFO:teuthology.orchestra.run.smithi003.stdout:] 2023-03-06T14:15:55.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.876+0000 7fbfa8bda700 1 -- 172.21.15.3:0/3156745348 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fbf840682f0 msgr2=0x7fbf8406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:55.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.876+0000 7fbfa8bda700 1 --2- 172.21.15.3:0/3156745348 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fbf840682f0 0x7fbf8406a7a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009b60 tx=0x7fbf980091c0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.876+0000 7fbfa8bda700 1 -- 172.21.15.3:0/3156745348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbfa40a6cd0 msgr2=0x7fbfa41e7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:55.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.876+0000 7fbfa8bda700 1 --2- 172.21.15.3:0/3156745348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbfa40a6cd0 0x7fbfa41e7ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c0056d0 tx=0x7fbf940047c0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.877+0000 7fbfa8bda700 1 -- 172.21.15.3:0/3156745348 shutdown_connections 2023-03-06T14:15:55.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.877+0000 7fbfa8bda700 1 --2- 172.21.15.3:0/3156745348 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fbf840682f0 0x7fbf8406a7a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.877+0000 7fbfa8bda700 1 --2- 172.21.15.3:0/3156745348 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfa41e7ff0 0x7fbfa40ba430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.877+0000 7fbfa8bda700 1 --2- 172.21.15.3:0/3156745348 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbf8c004430 0x7fbfa40a6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.877+0000 7fbfa8bda700 1 --2- 172.21.15.3:0/3156745348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbfa40a6cd0 0x7fbfa41e7ab0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:55.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.877+0000 7fbfa8bda700 1 -- 172.21.15.3:0/3156745348 >> 172.21.15.3:0/3156745348 conn(0x7fbfa40c2150 msgr2=0x7fbfa40c0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:55.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.877+0000 7fbfa8bda700 1 -- 172.21.15.3:0/3156745348 shutdown_connections 2023-03-06T14:15:55.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:55.877+0000 7fbfa8bda700 1 -- 172.21.15.3:0/3156745348 wait complete. 2023-03-06T14:15:55.891 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-03-06T14:15:55.891 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-03-06T14:15:56.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.017+0000 7f5f7a207700 1 Processor -- start 2023-03-06T14:15:56.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.017+0000 7f5f7a207700 1 -- start start 2023-03-06T14:15:56.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.018+0000 7f5f7a207700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5f7406da30 0x7f5f740a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:56.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.018+0000 7f5f7a207700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f74070960 0x7f5f740c2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:56.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.018+0000 7f5f7a207700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7406f480 con 0x7f5f740c2960 2023-03-06T14:15:56.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.018+0000 7f5f7a207700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f740a2a20 con 0x7f5f7406da30 2023-03-06T14:15:56.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.018+0000 7f5f7a207700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f740a2760 con 0x7f5f74070960 2023-03-06T14:15:56.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.018+0000 7f5f737fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5f7406da30 0x7f5f740a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:56.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.018+0000 7f5f737fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5f7406da30 0x7f5f740a69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55462/0 (socket says 172.21.15.3:55462) 2023-03-06T14:15:56.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.018+0000 7f5f73fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f5f740c2960 0x7f5f740bdce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57738/0 (socket says 172.21.15.3:57738) 2023-03-06T14:15:56.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.018+0000 7f5f737fe700 1 -- 172.21.15.3:0/1291247873 learned_addr learned my addr 172.21.15.3:0/1291247873 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:56.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.018+0000 7f5f72ffd700 1 --2- 172.21.15.3:0/1291247873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f74070960 0x7f5f740c2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:56.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.018+0000 7f5f737fe700 1 -- 172.21.15.3:0/1291247873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f74070960 msgr2=0x7f5f740c2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:56.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.018+0000 7f5f737fe700 1 --2- 172.21.15.3:0/1291247873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f74070960 0x7f5f740c2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:56.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.018+0000 7f5f737fe700 1 -- 172.21.15.3:0/1291247873 >> v1:172.21.15.3:6789/0 conn(0x7f5f740c2960 legacy=0x7f5f740bdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:56.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.018+0000 7f5f727fc700 1 -- 172.21.15.3:0/1291247873 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904354361 0 0) 0x7f5f7406f480 con 0x7f5f740c2960 2023-03-06T14:15:56.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.018+0000 7f5f737fe700 1 -- 172.21.15.3:0/1291247873 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f740c1740 con 0x7f5f7406da30 2023-03-06T14:15:56.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.019+0000 7f5f737fe700 1 --2- 172.21.15.3:0/1291247873 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f7406da30 0x7f5f740a69f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5f640098f0 tx=0x7f5f64009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc080219138380a server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:56.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.019+0000 7f5f727fc700 1 -- 172.21.15.3:0/1291247873 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f64011830 con 0x7f5f7406da30 2023-03-06T14:15:56.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.019+0000 7f5f727fc700 1 -- 172.21.15.3:0/1291247873 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f64011990 con 0x7f5f7406da30 2023-03-06T14:15:56.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.019+0000 7f5f727fc700 1 -- 172.21.15.3:0/1291247873 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f64011d20 con 0x7f5f7406da30 2023-03-06T14:15:56.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.019+0000 7f5f7a207700 1 -- 172.21.15.3:0/1291247873 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f7406da30 msgr2=0x7f5f740a69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:56.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.019+0000 7f5f7a207700 1 --2- 172.21.15.3:0/1291247873 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f7406da30 0x7f5f740a69f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5f640098f0 tx=0x7f5f64009c00 comp rx=0 tx=0).stop 2023-03-06T14:15:56.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.019+0000 7f5f7a207700 1 -- 172.21.15.3:0/1291247873 shutdown_connections 2023-03-06T14:15:56.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.019+0000 7f5f7a207700 1 --2- 172.21.15.3:0/1291247873 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f7406da30 0x7f5f740a69f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:56.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.019+0000 7f5f7a207700 1 --2- 172.21.15.3:0/1291247873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f74070960 0x7f5f740c2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:56.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.019+0000 7f5f7a207700 1 -- 172.21.15.3:0/1291247873 >> 172.21.15.3:0/1291247873 conn(0x7f5f740c30c0 msgr2=0x7f5f740c34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:56.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.019+0000 7f5f7a207700 1 -- 172.21.15.3:0/1291247873 shutdown_connections 2023-03-06T14:15:56.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.019+0000 7f5f7a207700 1 -- 172.21.15.3:0/1291247873 wait complete. 2023-03-06T14:15:56.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.021+0000 7f5f7a207700 1 Processor -- start 2023-03-06T14:15:56.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.021+0000 7f5f7a207700 1 -- start start 2023-03-06T14:15:56.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.022+0000 7f5f7a207700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f7406da30 0x7f5f7406b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:56.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.022+0000 7f5f7a207700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f74070960 0x7f5f7406bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:56.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.022+0000 7f5f7a207700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f740c2960 0x7f5f741e7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:56.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.022+0000 7f5f7a207700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f741e8740 con 0x7f5f74070960 2023-03-06T14:15:56.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.022+0000 7f5f7a207700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7406c210 con 0x7f5f740c2960 2023-03-06T14:15:56.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.022+0000 7f5f7a207700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f741d0fc0 con 0x7f5f7406da30 2023-03-06T14:15:56.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.022+0000 7f5f72ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f74070960 0x7f5f7406bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:56.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.022+0000 7f5f72ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f74070960 0x7f5f7406bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55470/0 (socket says 172.21.15.3:55470) 2023-03-06T14:15:56.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.022+0000 7f5f72ffd700 1 -- 172.21.15.3:0/2548151365 learned_addr learned my addr 172.21.15.3:0/2548151365 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:56.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.022+0000 7f5f72ffd700 1 -- 172.21.15.3:0/2548151365 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f7406da30 msgr2=0x7f5f7406b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:56.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.022+0000 7f5f737fe700 1 --2- 172.21.15.3:0/2548151365 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f7406da30 0x7f5f7406b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:56.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.022+0000 7f5f73fff700 1 --2- 172.21.15.3:0/2548151365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f740c2960 0x7f5f741e7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:56.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.022+0000 7f5f72ffd700 1 --2- 172.21.15.3:0/2548151365 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f7406da30 0x7f5f7406b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:56.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.022+0000 7f5f72ffd700 1 -- 172.21.15.3:0/2548151365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f740c2960 msgr2=0x7f5f741e7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:56.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.022+0000 7f5f72ffd700 1 --2- 172.21.15.3:0/2548151365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f740c2960 0x7f5f741e7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:56.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.022+0000 7f5f72ffd700 1 -- 172.21.15.3:0/2548151365 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f64009550 con 0x7f5f74070960 2023-03-06T14:15:56.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.023+0000 7f5f72ffd700 1 --2- 172.21.15.3:0/2548151365 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f74070960 0x7f5f7406bcd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00e870 tx=0x7f5f5c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:56.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.023+0000 7f5f6bfff700 1 -- 172.21.15.3:0/2548151365 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c009590 con 0x7f5f74070960 2023-03-06T14:15:56.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.023+0000 7f5f6bfff700 1 -- 172.21.15.3:0/2548151365 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c00ee70 con 0x7f5f74070960 2023-03-06T14:15:56.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.023+0000 7f5f7a207700 1 -- 172.21.15.3:0/2548151365 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f74070440 con 0x7f5f74070960 2023-03-06T14:15:56.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.023+0000 7f5f6bfff700 1 -- 172.21.15.3:0/2548151365 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c00ca50 con 0x7f5f74070960 2023-03-06T14:15:56.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.023+0000 7f5f7a207700 1 -- 172.21.15.3:0/2548151365 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f740c1cf0 con 0x7f5f74070960 2023-03-06T14:15:56.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.024+0000 7f5f7a207700 1 -- 172.21.15.3:0/2548151365 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7406f6d0 con 0x7f5f74070960 2023-03-06T14:15:56.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.024+0000 7f5f6bfff700 1 -- 172.21.15.3:0/2548151365 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5f5c019030 con 0x7f5f74070960 2023-03-06T14:15:56.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.025+0000 7f5f6bfff700 1 --2- 172.21.15.3:0/2548151365 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f5f540682f0 0x7f5f5406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:56.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.025+0000 7f5f6bfff700 1 -- 172.21.15.3:0/2548151365 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5f5c085740 con 0x7f5f74070960 2023-03-06T14:15:56.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.025+0000 7f5f737fe700 1 --2- 172.21.15.3:0/2548151365 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f5f540682f0 0x7f5f5406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:56.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.025+0000 7f5f737fe700 1 --2- 172.21.15.3:0/2548151365 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f5f540682f0 0x7f5f5406a7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5f64014040 tx=0x7f5f64008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:56.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.029+0000 7f5f6bfff700 1 -- 172.21.15.3:0/2548151365 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5f5c0522f0 con 0x7f5f74070960 2023-03-06T14:15:56.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:56.224+0000 7f5f7a207700 1 -- 172.21.15.3:0/2548151365 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5f74067670 con 0x7f5f74070960 2023-03-06T14:15:57.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.176+0000 7f5f6bfff700 1 -- 172.21.15.3:0/2548151365 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5f5c055910 con 0x7f5f74070960 2023-03-06T14:15:57.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.180+0000 7f5f7a207700 1 -- 172.21.15.3:0/2548151365 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f5f540682f0 msgr2=0x7f5f5406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:57.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.180+0000 7f5f7a207700 1 --2- 172.21.15.3:0/2548151365 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f5f540682f0 0x7f5f5406a7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5f64014040 tx=0x7f5f64008030 comp rx=0 tx=0).stop 2023-03-06T14:15:57.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.180+0000 7f5f7a207700 1 -- 172.21.15.3:0/2548151365 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f74070960 msgr2=0x7f5f7406bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:57.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.180+0000 7f5f7a207700 1 --2- 172.21.15.3:0/2548151365 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f74070960 0x7f5f7406bcd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00e870 tx=0x7f5f5c00ec30 comp rx=0 tx=0).stop 2023-03-06T14:15:57.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.181+0000 7f5f7a207700 1 -- 172.21.15.3:0/2548151365 shutdown_connections 2023-03-06T14:15:57.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.181+0000 7f5f7a207700 1 --2- 172.21.15.3:0/2548151365 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f5f540682f0 0x7f5f5406a7a0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5f64014040 tx=0x7f5f64008030 comp rx=0 tx=0).stop 2023-03-06T14:15:57.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.181+0000 7f5f7a207700 1 --2- 172.21.15.3:0/2548151365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f740c2960 0x7f5f741e7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:57.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.181+0000 7f5f7a207700 1 --2- 172.21.15.3:0/2548151365 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f7406da30 0x7f5f7406b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:57.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.181+0000 7f5f7a207700 1 --2- 172.21.15.3:0/2548151365 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f74070960 0x7f5f7406bcd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:57.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.181+0000 7f5f7a207700 1 -- 172.21.15.3:0/2548151365 >> 172.21.15.3:0/2548151365 conn(0x7f5f740c30c0 msgr2=0x7f5f740a7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:57.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.182+0000 7f5f7a207700 1 -- 172.21.15.3:0/2548151365 shutdown_connections 2023-03-06T14:15:57.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.182+0000 7f5f7a207700 1 -- 172.21.15.3:0/2548151365 wait complete. 2023-03-06T14:15:57.185 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' created 2023-03-06T14:15:57.200 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-03-06T14:15:57.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.335+0000 7f6a4ae80700 1 Processor -- start 2023-03-06T14:15:57.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.335+0000 7f6a4ae80700 1 -- start start 2023-03-06T14:15:57.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.336+0000 7f6a4ae80700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6a4406ea70 0x7f6a440bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:57.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.336+0000 7f6a4ae80700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6a4406ee40 0x7f6a441490f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:57.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.336+0000 7f6a4ae80700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4414ff80 con 0x7f6a440bdd60 2023-03-06T14:15:57.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.336+0000 7f6a4ae80700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a440b9070 con 0x7f6a4406ee40 2023-03-06T14:15:57.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.336+0000 7f6a4ae80700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a440bcb90 con 0x7f6a4406ea70 2023-03-06T14:15:57.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.336+0000 7f6a43fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6a4406ee40 0x7f6a441490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:57.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.336+0000 7f6a43fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6a4406ee40 0x7f6a441490f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55478/0 (socket says 172.21.15.3:55478) 2023-03-06T14:15:57.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.336+0000 7f6a43fff700 1 -- 172.21.15.3:0/1060326532 learned_addr learned my addr 172.21.15.3:0/1060326532 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:57.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.336+0000 7f6a4941d700 1 --1- 172.21.15.3:0/1060326532 >> v1:172.21.15.3:6789/0 conn(0x7f6a440bdd60 0x7f6a4406c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57752/0 (socket says 172.21.15.3:57752) 2023-03-06T14:15:57.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.336+0000 7f6a48c1c700 1 --2- 172.21.15.3:0/1060326532 >> v2:172.21.15.136:3300/0 conn(0x7f6a4406ea70 0x7f6a440bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:57.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.336+0000 7f6a43fff700 1 -- 172.21.15.3:0/1060326532 >> v2:172.21.15.136:3300/0 conn(0x7f6a4406ea70 msgr2=0x7f6a440bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:57.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.336+0000 7f6a43fff700 1 --2- 172.21.15.3:0/1060326532 >> v2:172.21.15.136:3300/0 conn(0x7f6a4406ea70 0x7f6a440bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:57.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.336+0000 7f6a43fff700 1 -- 172.21.15.3:0/1060326532 >> v1:172.21.15.3:6789/0 conn(0x7f6a440bdd60 legacy=0x7f6a4406c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:57.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.336+0000 7f6a437fe700 1 -- 172.21.15.3:0/1060326532 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047312325 0 0) 0x7f6a4414ff80 con 0x7f6a440bdd60 2023-03-06T14:15:57.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.336+0000 7f6a43fff700 1 -- 172.21.15.3:0/1060326532 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a440bce70 con 0x7f6a4406ee40 2023-03-06T14:15:57.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.336+0000 7f6a43fff700 1 --2- 172.21.15.3:0/1060326532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a4406ee40 0x7f6a441490f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a44072740 tx=0x7f6a30009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375f5e714ee61d68 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:57.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.337+0000 7f6a437fe700 1 -- 172.21.15.3:0/1060326532 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3000b870 con 0x7f6a4406ee40 2023-03-06T14:15:57.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.337+0000 7f6a437fe700 1 -- 172.21.15.3:0/1060326532 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3000b9d0 con 0x7f6a4406ee40 2023-03-06T14:15:57.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.337+0000 7f6a437fe700 1 -- 172.21.15.3:0/1060326532 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3000bd60 con 0x7f6a4406ee40 2023-03-06T14:15:57.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.337+0000 7f6a4ae80700 1 -- 172.21.15.3:0/1060326532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a4406ee40 msgr2=0x7f6a441490f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:57.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.337+0000 7f6a4ae80700 1 --2- 172.21.15.3:0/1060326532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a4406ee40 0x7f6a441490f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a44072740 tx=0x7f6a30009bd0 comp rx=0 tx=0).stop 2023-03-06T14:15:57.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.337+0000 7f6a4ae80700 1 -- 172.21.15.3:0/1060326532 shutdown_connections 2023-03-06T14:15:57.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.337+0000 7f6a4ae80700 1 --2- 172.21.15.3:0/1060326532 >> v2:172.21.15.136:3300/0 conn(0x7f6a4406ea70 0x7f6a440bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:57.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.337+0000 7f6a4ae80700 1 --2- 172.21.15.3:0/1060326532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a4406ee40 0x7f6a441490f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:57.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.337+0000 7f6a4ae80700 1 -- 172.21.15.3:0/1060326532 >> 172.21.15.3:0/1060326532 conn(0x7f6a440c2150 msgr2=0x7f6a440c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:57.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.337+0000 7f6a4ae80700 1 -- 172.21.15.3:0/1060326532 shutdown_connections 2023-03-06T14:15:57.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.337+0000 7f6a4ae80700 1 -- 172.21.15.3:0/1060326532 wait complete. 2023-03-06T14:15:57.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.338+0000 7f6a4ae80700 1 Processor -- start 2023-03-06T14:15:57.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.338+0000 7f6a4ae80700 1 -- start start 2023-03-06T14:15:57.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.339+0000 7f6a4ae80700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a4406ea70 0x7f6a44147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:57.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.339+0000 7f6a4ae80700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a4406ee40 0x7f6a4414e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:57.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.339+0000 7f6a4ae80700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a440bdd60 0x7f6a441e55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:57.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.339+0000 7f6a4ae80700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440a6f10 con 0x7f6a4406ea70 2023-03-06T14:15:57.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.339+0000 7f6a4ae80700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4414b930 con 0x7f6a440bdd60 2023-03-06T14:15:57.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.339+0000 7f6a4ae80700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440a49f0 con 0x7f6a4406ee40 2023-03-06T14:15:57.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.339+0000 7f6a48c1c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a4406ea70 0x7f6a44147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:57.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.339+0000 7f6a48c1c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a4406ea70 0x7f6a44147e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55482/0 (socket says 172.21.15.3:55482) 2023-03-06T14:15:57.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.339+0000 7f6a48c1c700 1 -- 172.21.15.3:0/714234962 learned_addr learned my addr 172.21.15.3:0/714234962 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:57.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.339+0000 7f6a43fff700 1 --2- 172.21.15.3:0/714234962 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a4406ee40 0x7f6a4414e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:57.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.339+0000 7f6a4941d700 1 --2- 172.21.15.3:0/714234962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a440bdd60 0x7f6a441e55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:57.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.340+0000 7f6a48c1c700 1 -- 172.21.15.3:0/714234962 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a4406ee40 msgr2=0x7f6a4414e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:57.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.340+0000 7f6a48c1c700 1 --2- 172.21.15.3:0/714234962 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a4406ee40 0x7f6a4414e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:57.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.340+0000 7f6a48c1c700 1 -- 172.21.15.3:0/714234962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a440bdd60 msgr2=0x7f6a441e55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:57.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.340+0000 7f6a48c1c700 1 --2- 172.21.15.3:0/714234962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a440bdd60 0x7f6a441e55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:57.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.340+0000 7f6a48c1c700 1 -- 172.21.15.3:0/714234962 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a30009550 con 0x7f6a4406ea70 2023-03-06T14:15:57.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.340+0000 7f6a4941d700 1 --2- 172.21.15.3:0/714234962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a440bdd60 0x7f6a441e55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:15:57.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.340+0000 7f6a48c1c700 1 --2- 172.21.15.3:0/714234962 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a4406ea70 0x7f6a44147e70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800e760 tx=0x7f6a3800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:57.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.340+0000 7f6a417fa700 1 -- 172.21.15.3:0/714234962 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a38013610 con 0x7f6a4406ea70 2023-03-06T14:15:57.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.340+0000 7f6a417fa700 1 -- 172.21.15.3:0/714234962 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a38013770 con 0x7f6a4406ea70 2023-03-06T14:15:57.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.340+0000 7f6a4ae80700 1 -- 172.21.15.3:0/714234962 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a44150220 con 0x7f6a4406ea70 2023-03-06T14:15:57.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.340+0000 7f6a417fa700 1 -- 172.21.15.3:0/714234962 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a38013b20 con 0x7f6a4406ea70 2023-03-06T14:15:57.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.340+0000 7f6a4ae80700 1 -- 172.21.15.3:0/714234962 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a440bd150 con 0x7f6a4406ea70 2023-03-06T14:15:57.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.341+0000 7f6a4ae80700 1 -- 172.21.15.3:0/714234962 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a440b8b80 con 0x7f6a4406ea70 2023-03-06T14:15:57.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.341+0000 7f6a417fa700 1 -- 172.21.15.3:0/714234962 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6a38019030 con 0x7f6a4406ea70 2023-03-06T14:15:57.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.342+0000 7f6a417fa700 1 --2- 172.21.15.3:0/714234962 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f6a28068320 0x7f6a2806a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:57.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.342+0000 7f6a417fa700 1 -- 172.21.15.3:0/714234962 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f6a38085360 con 0x7f6a4406ea70 2023-03-06T14:15:57.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.342+0000 7f6a43fff700 1 --2- 172.21.15.3:0/714234962 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f6a28068320 0x7f6a2806a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:57.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.343+0000 7f6a43fff700 1 --2- 172.21.15.3:0/714234962 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f6a28068320 0x7f6a2806a7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6a30009c10 tx=0x7f6a30008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:57.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.347+0000 7f6a417fa700 1 -- 172.21.15.3:0/714234962 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6a38051da0 con 0x7f6a4406ea70 2023-03-06T14:15:57.499 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:15:57.502 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:15:57.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:57.539+0000 7f6a4ae80700 1 -- 172.21.15.3:0/714234962 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f6a440a7130 con 0x7f6a4406ea70 2023-03-06T14:15:58.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.180+0000 7f6a417fa700 1 -- 172.21.15.3:0/714234962 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7f6a380553c0 con 0x7f6a4406ea70 2023-03-06T14:15:58.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.185+0000 7f6a4ae80700 1 -- 172.21.15.3:0/714234962 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f6a28068320 msgr2=0x7f6a2806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:58.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.185+0000 7f6a4ae80700 1 --2- 172.21.15.3:0/714234962 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f6a28068320 0x7f6a2806a7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6a30009c10 tx=0x7f6a30008030 comp rx=0 tx=0).stop 2023-03-06T14:15:58.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.185+0000 7f6a4ae80700 1 -- 172.21.15.3:0/714234962 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a4406ea70 msgr2=0x7f6a44147e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:58.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.185+0000 7f6a4ae80700 1 --2- 172.21.15.3:0/714234962 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a4406ea70 0x7f6a44147e70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800e760 tx=0x7f6a3800ea70 comp rx=0 tx=0).stop 2023-03-06T14:15:58.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.186+0000 7f6a4ae80700 1 -- 172.21.15.3:0/714234962 shutdown_connections 2023-03-06T14:15:58.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.186+0000 7f6a4ae80700 1 --2- 172.21.15.3:0/714234962 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f6a28068320 0x7f6a2806a7d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:58.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.186+0000 7f6a4ae80700 1 --2- 172.21.15.3:0/714234962 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a4406ea70 0x7f6a44147e70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:58.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.186+0000 7f6a4ae80700 1 --2- 172.21.15.3:0/714234962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a440bdd60 0x7f6a441e55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:58.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.186+0000 7f6a4ae80700 1 --2- 172.21.15.3:0/714234962 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a4406ee40 0x7f6a4414e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:58.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.186+0000 7f6a4ae80700 1 -- 172.21.15.3:0/714234962 >> 172.21.15.3:0/714234962 conn(0x7f6a440c2150 msgr2=0x7f6a440c0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:58.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.187+0000 7f6a4ae80700 1 -- 172.21.15.3:0/714234962 shutdown_connections 2023-03-06T14:15:58.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.187+0000 7f6a4ae80700 1 -- 172.21.15.3:0/714234962 wait complete. 2023-03-06T14:15:58.192 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' created 2023-03-06T14:15:58.213 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-03-06T14:15:58.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.343+0000 7fa75664f700 1 Processor -- start 2023-03-06T14:15:58.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.343+0000 7fa75664f700 1 -- start start 2023-03-06T14:15:58.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.344+0000 7fa75664f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa750146f60 0x7fa75006e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:58.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.344+0000 7fa75664f700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa75006edd0 0x7fa75006b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:58.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.344+0000 7fa75664f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa75014da60 0x7fa75006b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:58.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.344+0000 7fa75664f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75006c490 con 0x7fa750146f60 2023-03-06T14:15:58.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.344+0000 7fa75664f700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75014df60 con 0x7fa75006edd0 2023-03-06T14:15:58.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.344+0000 7fa75664f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75006bed0 con 0x7fa75014da60 2023-03-06T14:15:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.344+0000 7fa74ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa750146f60 0x7fa75006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.344+0000 7fa74ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa750146f60 0x7fa75006e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55490/0 (socket says 172.21.15.3:55490) 2023-03-06T14:15:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.344+0000 7fa74ffff700 1 -- 172.21.15.3:0/820404794 learned_addr learned my addr 172.21.15.3:0/820404794 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.344+0000 7fa754bec700 1 --2- 172.21.15.3:0/820404794 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa75014da60 0x7fa75006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.344+0000 7fa74f7fe700 1 --2- 172.21.15.3:0/820404794 >> v2:172.21.15.136:3300/0 conn(0x7fa75006edd0 0x7fa75006b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.344+0000 7fa74ffff700 1 -- 172.21.15.3:0/820404794 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa75014da60 msgr2=0x7fa75006b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.345+0000 7fa74ffff700 1 --2- 172.21.15.3:0/820404794 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa75014da60 0x7fa75006b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:58.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.345+0000 7fa74ffff700 1 -- 172.21.15.3:0/820404794 >> v2:172.21.15.136:3300/0 conn(0x7fa75006edd0 msgr2=0x7fa75006b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:58.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.345+0000 7fa74ffff700 1 --2- 172.21.15.3:0/820404794 >> v2:172.21.15.136:3300/0 conn(0x7fa75006edd0 0x7fa75006b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:58.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.345+0000 7fa74ffff700 1 -- 172.21.15.3:0/820404794 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75006c1b0 con 0x7fa750146f60 2023-03-06T14:15:58.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.345+0000 7fa74ffff700 1 --2- 172.21.15.3:0/820404794 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa750146f60 0x7fa75006e890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa7500b9420 tx=0x7fa740009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d746879151cbf7d server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:58.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.345+0000 7fa74effd700 1 -- 172.21.15.3:0/820404794 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa740005e30 con 0x7fa750146f60 2023-03-06T14:15:58.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.345+0000 7fa74effd700 1 -- 172.21.15.3:0/820404794 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa740004030 con 0x7fa750146f60 2023-03-06T14:15:58.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.345+0000 7fa74effd700 1 -- 172.21.15.3:0/820404794 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7400043e0 con 0x7fa750146f60 2023-03-06T14:15:58.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.345+0000 7fa75664f700 1 -- 172.21.15.3:0/820404794 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa750146f60 msgr2=0x7fa75006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:58.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.345+0000 7fa75664f700 1 --2- 172.21.15.3:0/820404794 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa750146f60 0x7fa75006e890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa7500b9420 tx=0x7fa740009bd0 comp rx=0 tx=0).stop 2023-03-06T14:15:58.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.345+0000 7fa75664f700 1 -- 172.21.15.3:0/820404794 shutdown_connections 2023-03-06T14:15:58.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.345+0000 7fa75664f700 1 --2- 172.21.15.3:0/820404794 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa75014da60 0x7fa75006b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:58.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.345+0000 7fa75664f700 1 --2- 172.21.15.3:0/820404794 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa750146f60 0x7fa75006e890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:58.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.345+0000 7fa75664f700 1 --2- 172.21.15.3:0/820404794 >> v2:172.21.15.136:3300/0 conn(0x7fa75006edd0 0x7fa75006b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:58.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.345+0000 7fa75664f700 1 -- 172.21.15.3:0/820404794 >> 172.21.15.3:0/820404794 conn(0x7fa7500c2150 msgr2=0x7fa7500c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:58.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.345+0000 7fa75664f700 1 -- 172.21.15.3:0/820404794 shutdown_connections 2023-03-06T14:15:58.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.345+0000 7fa75664f700 1 -- 172.21.15.3:0/820404794 wait complete. 2023-03-06T14:15:58.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.346+0000 7fa75664f700 1 Processor -- start 2023-03-06T14:15:58.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.347+0000 7fa75664f700 1 -- start start 2023-03-06T14:15:58.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.347+0000 7fa75664f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa75006edd0 0x7fa7501e7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:58.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.347+0000 7fa75664f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa750146f60 0x7fa7501e5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:58.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.347+0000 7fa75664f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa75014da60 0x7fa75014c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:58.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.347+0000 7fa75664f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7501e8b20 con 0x7fa75006edd0 2023-03-06T14:15:58.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.347+0000 7fa75664f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa750150d70 con 0x7fa75014da60 2023-03-06T14:15:58.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.347+0000 7fa75664f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7501e4c70 con 0x7fa750146f60 2023-03-06T14:15:58.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.347+0000 7fa74ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa75006edd0 0x7fa7501e7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:58.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.347+0000 7fa74ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa75006edd0 0x7fa7501e7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55496/0 (socket says 172.21.15.3:55496) 2023-03-06T14:15:58.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.347+0000 7fa74ffff700 1 -- 172.21.15.3:0/358818610 learned_addr learned my addr 172.21.15.3:0/358818610 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:58.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.348+0000 7fa74f7fe700 1 --2- 172.21.15.3:0/358818610 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa750146f60 0x7fa7501e5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:58.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.348+0000 7fa754bec700 1 --2- 172.21.15.3:0/358818610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa75014da60 0x7fa75014c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:58.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.348+0000 7fa74ffff700 1 -- 172.21.15.3:0/358818610 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa750146f60 msgr2=0x7fa7501e5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:58.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.348+0000 7fa74ffff700 1 --2- 172.21.15.3:0/358818610 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa750146f60 0x7fa7501e5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:58.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.348+0000 7fa74ffff700 1 -- 172.21.15.3:0/358818610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa75014da60 msgr2=0x7fa75014c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:58.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.348+0000 7fa74ffff700 1 --2- 172.21.15.3:0/358818610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa75014da60 0x7fa75014c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:58.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.348+0000 7fa74ffff700 1 -- 172.21.15.3:0/358818610 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa740009500 con 0x7fa75006edd0 2023-03-06T14:15:58.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.348+0000 7fa74f7fe700 1 --2- 172.21.15.3:0/358818610 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa750146f60 0x7fa7501e5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:15:58.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.348+0000 7fa754bec700 1 --2- 172.21.15.3:0/358818610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa75014da60 0x7fa75014c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:15:58.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.348+0000 7fa74ffff700 1 --2- 172.21.15.3:0/358818610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa75006edd0 0x7fa7501e7b40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa740009130 tx=0x7fa740004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:58.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.348+0000 7fa74cff9700 1 -- 172.21.15.3:0/358818610 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa740003dd0 con 0x7fa75006edd0 2023-03-06T14:15:58.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.348+0000 7fa74cff9700 1 -- 172.21.15.3:0/358818610 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa740011420 con 0x7fa75006edd0 2023-03-06T14:15:58.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.348+0000 7fa75664f700 1 -- 172.21.15.3:0/358818610 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa750147330 con 0x7fa75006edd0 2023-03-06T14:15:58.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.348+0000 7fa74cff9700 1 -- 172.21.15.3:0/358818610 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7400117d0 con 0x7fa75006edd0 2023-03-06T14:15:58.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.348+0000 7fa75664f700 1 -- 172.21.15.3:0/358818610 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75006ad00 con 0x7fa75006edd0 2023-03-06T14:15:58.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.349+0000 7fa75664f700 1 -- 172.21.15.3:0/358818610 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7501474c0 con 0x7fa75006edd0 2023-03-06T14:15:58.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.350+0000 7fa74cff9700 1 -- 172.21.15.3:0/358818610 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa74002c070 con 0x7fa75006edd0 2023-03-06T14:15:58.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.350+0000 7fa74cff9700 1 --2- 172.21.15.3:0/358818610 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa7300682f0 0x7fa73006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:58.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.350+0000 7fa74cff9700 1 -- 172.21.15.3:0/358818610 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fa740086dd0 con 0x7fa75006edd0 2023-03-06T14:15:58.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.350+0000 7fa74f7fe700 1 --2- 172.21.15.3:0/358818610 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa7300682f0 0x7fa73006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:58.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.351+0000 7fa74f7fe700 1 --2- 172.21.15.3:0/358818610 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa7300682f0 0x7fa73006a7a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa7500c1b20 tx=0x7fa738008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:58.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.355+0000 7fa74cff9700 1 -- 172.21.15.3:0/358818610 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa740053630 con 0x7fa75006edd0 2023-03-06T14:15:58.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.594+0000 7fa75664f700 1 -- 172.21.15.3:0/358818610 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa7500b9090 con 0x7fa75006edd0 2023-03-06T14:15:58.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.600+0000 7fa74cff9700 1 -- 172.21.15.3:0/358818610 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa740056c50 con 0x7fa75006edd0 2023-03-06T14:15:58.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.604+0000 7fa75664f700 1 -- 172.21.15.3:0/358818610 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa7300682f0 msgr2=0x7fa73006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:58.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.604+0000 7fa75664f700 1 --2- 172.21.15.3:0/358818610 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa7300682f0 0x7fa73006a7a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa7500c1b20 tx=0x7fa738008040 comp rx=0 tx=0).stop 2023-03-06T14:15:58.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.604+0000 7fa75664f700 1 -- 172.21.15.3:0/358818610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa75006edd0 msgr2=0x7fa7501e7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:58.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.604+0000 7fa75664f700 1 --2- 172.21.15.3:0/358818610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa75006edd0 0x7fa7501e7b40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa740009130 tx=0x7fa740004750 comp rx=0 tx=0).stop 2023-03-06T14:15:58.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.605+0000 7fa75664f700 1 -- 172.21.15.3:0/358818610 shutdown_connections 2023-03-06T14:15:58.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.605+0000 7fa75664f700 1 --2- 172.21.15.3:0/358818610 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa7300682f0 0x7fa73006a7a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:58.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.605+0000 7fa75664f700 1 --2- 172.21.15.3:0/358818610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa75006edd0 0x7fa7501e7b40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:58.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.605+0000 7fa75664f700 1 --2- 172.21.15.3:0/358818610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa75014da60 0x7fa75014c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:58.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.605+0000 7fa75664f700 1 --2- 172.21.15.3:0/358818610 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa750146f60 0x7fa7501e5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:58.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.605+0000 7fa75664f700 1 -- 172.21.15.3:0/358818610 >> 172.21.15.3:0/358818610 conn(0x7fa7500c2150 msgr2=0x7fa7500bc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:58.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.605+0000 7fa75664f700 1 -- 172.21.15.3:0/358818610 shutdown_connections 2023-03-06T14:15:58.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.605+0000 7fa75664f700 1 -- 172.21.15.3:0/358818610 wait complete. 2023-03-06T14:15:58.615 INFO:teuthology.orchestra.run.smithi003.stderr:new fs with metadata pool 3 and data pool 4 2023-03-06T14:15:58.630 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-03-06T14:15:58.630 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-03-06T14:15:58.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.759+0000 7f0f691ca700 1 Processor -- start 2023-03-06T14:15:58.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.759+0000 7f0f691ca700 1 -- start start 2023-03-06T14:15:58.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.760+0000 7f0f691ca700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f6414da00 0x7f0f6406a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:58.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.760+0000 7f0f691ca700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6414df00 con 0x7f0f640702f0 2023-03-06T14:15:58.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.760+0000 7f0f691ca700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6406a4e0 con 0x7f0f640c23e0 2023-03-06T14:15:58.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.760+0000 7f0f691ca700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6414aaa0 con 0x7f0f6414da00 2023-03-06T14:15:58.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.761+0000 7f0f6359e700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f0f640702f0 0x7f0f640a1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57792/0 (socket says 172.21.15.3:57792) 2023-03-06T14:15:58.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.761+0000 7f0f6359e700 1 -- 172.21.15.3:0/1469187916 learned_addr learned my addr 172.21.15.3:0/1469187916 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:15:58.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.761+0000 7f0f6259c700 1 --2- 172.21.15.3:0/1469187916 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f6414da00 0x7f0f6406a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:58.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.761+0000 7f0f61d9b700 1 -- 172.21.15.3:0/1469187916 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349832294 0 0) 0x7f0f6414df00 con 0x7f0f640702f0 2023-03-06T14:15:58.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.761+0000 7f0f61d9b700 1 -- 172.21.15.3:0/1469187916 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f4c0035b0 con 0x7f0f640702f0 2023-03-06T14:15:58.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.761+0000 7f0f61d9b700 1 -- 172.21.15.3:0/1469187916 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506733396 0 0) 0x7f0f6406a4e0 con 0x7f0f640c23e0 2023-03-06T14:15:58.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.761+0000 7f0f61d9b700 1 -- 172.21.15.3:0/1469187916 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f6414df00 con 0x7f0f640c23e0 2023-03-06T14:15:58.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.761+0000 7f0f6259c700 1 -- 172.21.15.3:0/1469187916 >> v1:172.21.15.136:6789/0 conn(0x7f0f640c23e0 legacy=0x7f0f640be880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:58.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.761+0000 7f0f6259c700 1 -- 172.21.15.3:0/1469187916 >> v1:172.21.15.3:6789/0 conn(0x7f0f640702f0 legacy=0x7f0f640a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:58.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.761+0000 7f0f61d9b700 1 -- 172.21.15.3:0/1469187916 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1517821308 0 0) 0x7f0f4c0035b0 con 0x7f0f640702f0 2023-03-06T14:15:58.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.761+0000 7f0f6259c700 1 -- 172.21.15.3:0/1469187916 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f640be3f0 con 0x7f0f6414da00 2023-03-06T14:15:58.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.761+0000 7f0f6259c700 1 --2- 172.21.15.3:0/1469187916 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f6414da00 0x7f0f6406a970 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009870 tx=0x7f0f54009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ab60b8bc0890c0e server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:58.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.761+0000 7f0f61d9b700 1 -- 172.21.15.3:0/1469187916 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0019f0 con 0x7f0f6414da00 2023-03-06T14:15:58.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.761+0000 7f0f61d9b700 1 -- 172.21.15.3:0/1469187916 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f54004030 con 0x7f0f6414da00 2023-03-06T14:15:58.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.761+0000 7f0f61d9b700 1 -- 172.21.15.3:0/1469187916 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f540043c0 con 0x7f0f6414da00 2023-03-06T14:15:58.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.762+0000 7f0f691ca700 1 -- 172.21.15.3:0/1469187916 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f6414da00 msgr2=0x7f0f6406a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:58.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.762+0000 7f0f691ca700 1 --2- 172.21.15.3:0/1469187916 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f6414da00 0x7f0f6406a970 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009870 tx=0x7f0f54009b80 comp rx=0 tx=0).stop 2023-03-06T14:15:58.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.762+0000 7f0f691ca700 1 -- 172.21.15.3:0/1469187916 shutdown_connections 2023-03-06T14:15:58.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.762+0000 7f0f691ca700 1 --2- 172.21.15.3:0/1469187916 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f6414da00 0x7f0f6406a970 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:58.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.762+0000 7f0f691ca700 1 -- 172.21.15.3:0/1469187916 >> 172.21.15.3:0/1469187916 conn(0x7f0f640c30c0 msgr2=0x7f0f640c34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:58.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.762+0000 7f0f691ca700 1 -- 172.21.15.3:0/1469187916 shutdown_connections 2023-03-06T14:15:58.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.762+0000 7f0f691ca700 1 -- 172.21.15.3:0/1469187916 wait complete. 2023-03-06T14:15:58.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.763+0000 7f0f691ca700 1 Processor -- start 2023-03-06T14:15:58.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.763+0000 7f0f691ca700 1 -- start start 2023-03-06T14:15:58.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.764+0000 7f0f691ca700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f640702f0 0x7f0f640b9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:58.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.764+0000 7f0f691ca700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f640c23e0 0x7f0f640a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:58.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.764+0000 7f0f691ca700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f6414da00 0x7f0f640a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:58.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.764+0000 7f0f691ca700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f640b9570 con 0x7f0f640702f0 2023-03-06T14:15:58.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.764+0000 7f0f691ca700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f640a82e0 con 0x7f0f6414da00 2023-03-06T14:15:58.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.764+0000 7f0f691ca700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f640a7c30 con 0x7f0f640c23e0 2023-03-06T14:15:58.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.764+0000 7f0f62d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f640702f0 0x7f0f640b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:58.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.764+0000 7f0f62d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f640702f0 0x7f0f640b9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55522/0 (socket says 172.21.15.3:55522) 2023-03-06T14:15:58.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.764+0000 7f0f62d9d700 1 -- 172.21.15.3:0/1742382815 learned_addr learned my addr 172.21.15.3:0/1742382815 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:58.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.764+0000 7f0f6259c700 1 --2- 172.21.15.3:0/1742382815 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f640c23e0 0x7f0f640a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:58.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.764+0000 7f0f62d9d700 1 -- 172.21.15.3:0/1742382815 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f640c23e0 msgr2=0x7f0f640a76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:58.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.764+0000 7f0f62d9d700 1 --2- 172.21.15.3:0/1742382815 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f640c23e0 0x7f0f640a76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:58.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.764+0000 7f0f6359e700 1 --2- 172.21.15.3:0/1742382815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f6414da00 0x7f0f640a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:58.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.764+0000 7f0f62d9d700 1 -- 172.21.15.3:0/1742382815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f6414da00 msgr2=0x7f0f640a87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:58.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.764+0000 7f0f62d9d700 1 --2- 172.21.15.3:0/1742382815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f6414da00 0x7f0f640a87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:58.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.765+0000 7f0f62d9d700 1 -- 172.21.15.3:0/1742382815 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f540094a0 con 0x7f0f640702f0 2023-03-06T14:15:58.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.765+0000 7f0f62d9d700 1 --2- 172.21.15.3:0/1742382815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f640702f0 0x7f0f640b9030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0f5800c520 tx=0x7f0f5800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:58.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.765+0000 7f0f4b7fe700 1 -- 172.21.15.3:0/1742382815 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f580052d0 con 0x7f0f640702f0 2023-03-06T14:15:58.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.765+0000 7f0f4b7fe700 1 -- 172.21.15.3:0/1742382815 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f58005430 con 0x7f0f640702f0 2023-03-06T14:15:58.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.765+0000 7f0f691ca700 1 -- 172.21.15.3:0/1742382815 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f64070ef0 con 0x7f0f640702f0 2023-03-06T14:15:58.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.765+0000 7f0f4b7fe700 1 -- 172.21.15.3:0/1742382815 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f580038c0 con 0x7f0f640702f0 2023-03-06T14:15:58.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.765+0000 7f0f691ca700 1 -- 172.21.15.3:0/1742382815 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f64070c10 con 0x7f0f640702f0 2023-03-06T14:15:58.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.766+0000 7f0f691ca700 1 -- 172.21.15.3:0/1742382815 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6406fe70 con 0x7f0f640702f0 2023-03-06T14:15:58.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.766+0000 7f0f4b7fe700 1 -- 172.21.15.3:0/1742382815 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0f58019030 con 0x7f0f640702f0 2023-03-06T14:15:58.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.767+0000 7f0f4b7fe700 1 --2- 172.21.15.3:0/1742382815 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0f500682f0 0x7f0f5006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:58.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.767+0000 7f0f4b7fe700 1 -- 172.21.15.3:0/1742382815 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0f58085100 con 0x7f0f640702f0 2023-03-06T14:15:58.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.767+0000 7f0f6259c700 1 --2- 172.21.15.3:0/1742382815 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0f500682f0 0x7f0f5006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:58.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.767+0000 7f0f6259c700 1 --2- 172.21.15.3:0/1742382815 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0f500682f0 0x7f0f5006a7a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0f6414de30 tx=0x7f0f54013040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:58.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.771+0000 7f0f4b7fe700 1 -- 172.21.15.3:0/1742382815 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0f58051960 con 0x7f0f640702f0 2023-03-06T14:15:58.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:58.974+0000 7f0f691ca700 1 -- 172.21.15.3:0/1742382815 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f0f64067670 con 0x7f0f640702f0 2023-03-06T14:15:59.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.605+0000 7f0f4b7fe700 1 -- 172.21.15.3:0/1742382815 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7f0f58054f80 con 0x7f0f640702f0 2023-03-06T14:15:59.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.608+0000 7f0f691ca700 1 -- 172.21.15.3:0/1742382815 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0f500682f0 msgr2=0x7f0f5006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:59.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.608+0000 7f0f691ca700 1 --2- 172.21.15.3:0/1742382815 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0f500682f0 0x7f0f5006a7a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0f6414de30 tx=0x7f0f54013040 comp rx=0 tx=0).stop 2023-03-06T14:15:59.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.609+0000 7f0f691ca700 1 -- 172.21.15.3:0/1742382815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f640702f0 msgr2=0x7f0f640b9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:59.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.609+0000 7f0f691ca700 1 --2- 172.21.15.3:0/1742382815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f640702f0 0x7f0f640b9030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0f5800c520 tx=0x7f0f5800c8e0 comp rx=0 tx=0).stop 2023-03-06T14:15:59.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.609+0000 7f0f691ca700 1 -- 172.21.15.3:0/1742382815 shutdown_connections 2023-03-06T14:15:59.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.609+0000 7f0f691ca700 1 --2- 172.21.15.3:0/1742382815 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0f500682f0 0x7f0f5006a7a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:59.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.609+0000 7f0f691ca700 1 --2- 172.21.15.3:0/1742382815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f640702f0 0x7f0f640b9030 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:59.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.609+0000 7f0f691ca700 1 --2- 172.21.15.3:0/1742382815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f6414da00 0x7f0f640a87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:59.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.609+0000 7f0f691ca700 1 --2- 172.21.15.3:0/1742382815 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f640c23e0 0x7f0f640a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:59.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.609+0000 7f0f691ca700 1 -- 172.21.15.3:0/1742382815 >> 172.21.15.3:0/1742382815 conn(0x7f0f640c30c0 msgr2=0x7f0f640be7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:59.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.609+0000 7f0f691ca700 1 -- 172.21.15.3:0/1742382815 shutdown_connections 2023-03-06T14:15:59.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.609+0000 7f0f691ca700 1 -- 172.21.15.3:0/1742382815 wait complete. 2023-03-06T14:15:59.626 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-03-06T14:15:59.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.763+0000 7f83c1a89700 1 Processor -- start 2023-03-06T14:15:59.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.763+0000 7f83c1a89700 1 -- start start 2023-03-06T14:15:59.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.764+0000 7f83c1a89700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83bc146430 0x7f83bc14c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:59.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.764+0000 7f83c1a89700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f83bc0bdf10 0x7f83bc0bd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:59.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.764+0000 7f83c1a89700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f83bc0b7010 0x7f83bc071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:59.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.764+0000 7f83c1a89700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc14ce70 con 0x7f83bc0bdf10 2023-03-06T14:15:59.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.764+0000 7f83c1a89700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc0bdcf0 con 0x7f83bc0b7010 2023-03-06T14:15:59.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.764+0000 7f83c1a89700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc0bd320 con 0x7f83bc146430 2023-03-06T14:15:59.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.764+0000 7f83baffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f83bc0bdf10 0x7f83bc0bd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:59.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.764+0000 7f83baffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f83bc0bdf10 0x7f83bc0bd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55532/0 (socket says 172.21.15.3:55532) 2023-03-06T14:15:59.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.764+0000 7f83baffd700 1 -- 172.21.15.3:0/3306675803 learned_addr learned my addr 172.21.15.3:0/3306675803 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:59.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.764+0000 7f83bb7fe700 1 --2- 172.21.15.3:0/3306675803 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83bc146430 0x7f83bc14c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:59.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.764+0000 7f83bbfff700 1 --2- 172.21.15.3:0/3306675803 >> v2:172.21.15.136:3300/0 conn(0x7f83bc0b7010 0x7f83bc071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:59.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.765+0000 7f83baffd700 1 -- 172.21.15.3:0/3306675803 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83bc146430 msgr2=0x7f83bc14c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:59.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.765+0000 7f83baffd700 1 --2- 172.21.15.3:0/3306675803 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83bc146430 0x7f83bc14c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:59.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.765+0000 7f83baffd700 1 -- 172.21.15.3:0/3306675803 >> v2:172.21.15.136:3300/0 conn(0x7f83bc0b7010 msgr2=0x7f83bc071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:15:59.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.765+0000 7f83baffd700 1 --2- 172.21.15.3:0/3306675803 >> v2:172.21.15.136:3300/0 conn(0x7f83bc0b7010 0x7f83bc071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:59.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.765+0000 7f83baffd700 1 -- 172.21.15.3:0/3306675803 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc06c210 con 0x7f83bc0bdf10 2023-03-06T14:15:59.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.765+0000 7f83baffd700 1 --2- 172.21.15.3:0/3306675803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83bc0bdf10 0x7f83bc0bd7b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f83bc06aa70 tx=0x7f83ac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b91415fac731ecf server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:59.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.765+0000 7f83ba7fc700 1 -- 172.21.15.3:0/3306675803 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00b870 con 0x7f83bc0bdf10 2023-03-06T14:15:59.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.765+0000 7f83ba7fc700 1 -- 172.21.15.3:0/3306675803 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac00b9d0 con 0x7f83bc0bdf10 2023-03-06T14:15:59.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.765+0000 7f83ba7fc700 1 -- 172.21.15.3:0/3306675803 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00bd60 con 0x7f83bc0bdf10 2023-03-06T14:15:59.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.765+0000 7f83c1a89700 1 -- 172.21.15.3:0/3306675803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83bc0bdf10 msgr2=0x7f83bc0bd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:59.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.765+0000 7f83c1a89700 1 --2- 172.21.15.3:0/3306675803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83bc0bdf10 0x7f83bc0bd7b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f83bc06aa70 tx=0x7f83ac009bd0 comp rx=0 tx=0).stop 2023-03-06T14:15:59.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.765+0000 7f83c1a89700 1 -- 172.21.15.3:0/3306675803 shutdown_connections 2023-03-06T14:15:59.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.765+0000 7f83c1a89700 1 --2- 172.21.15.3:0/3306675803 >> v2:172.21.15.136:3300/0 conn(0x7f83bc0b7010 0x7f83bc071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:59.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.765+0000 7f83c1a89700 1 --2- 172.21.15.3:0/3306675803 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83bc146430 0x7f83bc14c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:59.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.765+0000 7f83c1a89700 1 --2- 172.21.15.3:0/3306675803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83bc0bdf10 0x7f83bc0bd7b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:59.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.765+0000 7f83c1a89700 1 -- 172.21.15.3:0/3306675803 >> 172.21.15.3:0/3306675803 conn(0x7f83bc0bf780 msgr2=0x7f83bc0715d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:15:59.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.765+0000 7f83c1a89700 1 -- 172.21.15.3:0/3306675803 shutdown_connections 2023-03-06T14:15:59.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.765+0000 7f83c1a89700 1 -- 172.21.15.3:0/3306675803 wait complete. 2023-03-06T14:15:59.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.767+0000 7f83c1a89700 1 Processor -- start 2023-03-06T14:15:59.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.767+0000 7f83c1a89700 1 -- start start 2023-03-06T14:15:59.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.767+0000 7f83c1a89700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83bc0b7010 0x7f83bc12a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:59.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.767+0000 7f83c1a89700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83bc0bdf10 0x7f83bc12de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:59.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.767+0000 7f83c1a89700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83bc146430 0x7f83bc127b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:59.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.767+0000 7f83c1a89700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc128450 con 0x7f83bc146430 2023-03-06T14:15:59.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.767+0000 7f83c1a89700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc12e350 con 0x7f83bc0bdf10 2023-03-06T14:15:59.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.767+0000 7f83c1a89700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc12e860 con 0x7f83bc0b7010 2023-03-06T14:15:59.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.768+0000 7f83bbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83bc146430 0x7f83bc127b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:59.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.768+0000 7f83bbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83bc146430 0x7f83bc127b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55540/0 (socket says 172.21.15.3:55540) 2023-03-06T14:15:59.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.768+0000 7f83bb7fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83bc0b7010 0x7f83bc12a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:59.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.768+0000 7f83bbfff700 1 -- 172.21.15.3:0/3216745676 learned_addr learned my addr 172.21.15.3:0/3216745676 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:15:59.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.768+0000 7f83baffd700 1 --2- 172.21.15.3:0/3216745676 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83bc0bdf10 0x7f83bc12de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:59.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.768+0000 7f83bbfff700 1 -- 172.21.15.3:0/3216745676 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83bc0b7010 msgr2=0x7f83bc12a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:59.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.768+0000 7f83bbfff700 1 --2- 172.21.15.3:0/3216745676 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83bc0b7010 0x7f83bc12a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:59.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.768+0000 7f83bbfff700 1 -- 172.21.15.3:0/3216745676 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83bc0bdf10 msgr2=0x7f83bc12de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:15:59.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.768+0000 7f83bbfff700 1 --2- 172.21.15.3:0/3216745676 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83bc0bdf10 0x7f83bc12de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:15:59.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.768+0000 7f83bbfff700 1 -- 172.21.15.3:0/3216745676 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac009550 con 0x7f83bc146430 2023-03-06T14:15:59.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.768+0000 7f83bbfff700 1 --2- 172.21.15.3:0/3216745676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83bc146430 0x7f83bc127b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f83b4007e60 tx=0x7f83b400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:59.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.768+0000 7f83b3fff700 1 -- 172.21.15.3:0/3216745676 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b400ecd0 con 0x7f83bc146430 2023-03-06T14:15:59.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.768+0000 7f83b3fff700 1 -- 172.21.15.3:0/3216745676 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b400ee50 con 0x7f83bc146430 2023-03-06T14:15:59.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.768+0000 7f83c1a89700 1 -- 172.21.15.3:0/3216745676 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83bc0bc9f0 con 0x7f83bc146430 2023-03-06T14:15:59.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.768+0000 7f83b3fff700 1 -- 172.21.15.3:0/3216745676 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b4014660 con 0x7f83bc146430 2023-03-06T14:15:59.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.768+0000 7f83c1a89700 1 -- 172.21.15.3:0/3216745676 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc0be3a0 con 0x7f83bc146430 2023-03-06T14:15:59.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.769+0000 7f83c1a89700 1 -- 172.21.15.3:0/3216745676 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83bc0bccd0 con 0x7f83bc146430 2023-03-06T14:15:59.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.770+0000 7f83b3fff700 1 -- 172.21.15.3:0/3216745676 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f83b4012050 con 0x7f83bc146430 2023-03-06T14:15:59.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.770+0000 7f83b3fff700 1 --2- 172.21.15.3:0/3216745676 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f839c0682f0 0x7f839c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:15:59.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.770+0000 7f83b3fff700 1 -- 172.21.15.3:0/3216745676 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f83b4086190 con 0x7f83bc146430 2023-03-06T14:15:59.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.770+0000 7f83bb7fe700 1 --2- 172.21.15.3:0/3216745676 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f839c0682f0 0x7f839c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:15:59.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.771+0000 7f83bb7fe700 1 --2- 172.21.15.3:0/3216745676 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f839c0682f0 0x7f839c06a7a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f83a4006b20 tx=0x7f83a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:15:59.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.774+0000 7f83b3fff700 1 -- 172.21.15.3:0/3216745676 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f83b4052910 con 0x7f83bc146430 2023-03-06T14:15:59.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:15:59.974+0000 7f83c1a89700 1 -- 172.21.15.3:0/3216745676 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f83bc067670 con 0x7f83bc146430 2023-03-06T14:16:01.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.619+0000 7f83b3fff700 1 -- 172.21.15.3:0/3216745676 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7f83b4055f30 con 0x7f83bc146430 2023-03-06T14:16:01.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.625+0000 7f83c1a89700 1 -- 172.21.15.3:0/3216745676 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f839c0682f0 msgr2=0x7f839c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:01.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.625+0000 7f83c1a89700 1 --2- 172.21.15.3:0/3216745676 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f839c0682f0 0x7f839c06a7a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f83a4006b20 tx=0x7f83a4008040 comp rx=0 tx=0).stop 2023-03-06T14:16:01.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.625+0000 7f83c1a89700 1 -- 172.21.15.3:0/3216745676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83bc146430 msgr2=0x7f83bc127b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:01.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.625+0000 7f83c1a89700 1 --2- 172.21.15.3:0/3216745676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83bc146430 0x7f83bc127b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f83b4007e60 tx=0x7f83b400e3c0 comp rx=0 tx=0).stop 2023-03-06T14:16:01.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.625+0000 7f83c1a89700 1 -- 172.21.15.3:0/3216745676 shutdown_connections 2023-03-06T14:16:01.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.625+0000 7f83c1a89700 1 --2- 172.21.15.3:0/3216745676 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f839c0682f0 0x7f839c06a7a0 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f83a4006b20 tx=0x7f83a4008040 comp rx=0 tx=0).stop 2023-03-06T14:16:01.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.625+0000 7f83c1a89700 1 --2- 172.21.15.3:0/3216745676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83bc146430 0x7f83bc127b50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:01.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.625+0000 7f83c1a89700 1 --2- 172.21.15.3:0/3216745676 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83bc0b7010 0x7f83bc12a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:01.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.625+0000 7f83c1a89700 1 --2- 172.21.15.3:0/3216745676 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83bc0bdf10 0x7f83bc12de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:01.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.625+0000 7f83c1a89700 1 -- 172.21.15.3:0/3216745676 >> 172.21.15.3:0/3216745676 conn(0x7f83bc0bf780 msgr2=0x7f83bc14c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:01.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.626+0000 7f83c1a89700 1 -- 172.21.15.3:0/3216745676 shutdown_connections 2023-03-06T14:16:01.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.626+0000 7f83c1a89700 1 -- 172.21.15.3:0/3216745676 wait complete. 2023-03-06T14:16:01.632 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data_ec' created 2023-03-06T14:16:01.645 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-03-06T14:16:01.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.779+0000 7f316429b700 1 Processor -- start 2023-03-06T14:16:01.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.779+0000 7f316429b700 1 -- start start 2023-03-06T14:16:01.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.780+0000 7f316429b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f315c06df30 0x7f315c06e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:01.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.780+0000 7f316429b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f315c06a2d0 0x7f315c14f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:01.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.780+0000 7f316429b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f315c0bdcc0 0x7f315c14fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:01.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.780+0000 7f316429b700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315c072150 con 0x7f315c06df30 2023-03-06T14:16:01.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.780+0000 7f316429b700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315c0a3230 con 0x7f315c0bdcc0 2023-03-06T14:16:01.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.780+0000 7f316429b700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315c14f430 con 0x7f315c06a2d0 2023-03-06T14:16:01.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.780+0000 7f3162037700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f315c06df30 0x7f315c06e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:01.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.780+0000 7f3162037700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f315c06df30 0x7f315c06e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55544/0 (socket says 172.21.15.3:55544) 2023-03-06T14:16:01.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.780+0000 7f3162037700 1 -- 172.21.15.3:0/1022849443 learned_addr learned my addr 172.21.15.3:0/1022849443 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:01.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.780+0000 7f3162838700 1 --2- 172.21.15.3:0/1022849443 >> v2:172.21.15.136:3300/0 conn(0x7f315c0bdcc0 0x7f315c14fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:01.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.780+0000 7f3161836700 1 --2- 172.21.15.3:0/1022849443 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f315c06a2d0 0x7f315c14f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:01.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.780+0000 7f3162037700 1 -- 172.21.15.3:0/1022849443 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f315c06a2d0 msgr2=0x7f315c14f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:01.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.780+0000 7f3162037700 1 --2- 172.21.15.3:0/1022849443 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f315c06a2d0 0x7f315c14f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:01.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.780+0000 7f3162037700 1 -- 172.21.15.3:0/1022849443 >> v2:172.21.15.136:3300/0 conn(0x7f315c0bdcc0 msgr2=0x7f315c14fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:01.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.780+0000 7f3162037700 1 --2- 172.21.15.3:0/1022849443 >> v2:172.21.15.136:3300/0 conn(0x7f315c0bdcc0 0x7f315c14fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:01.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.780+0000 7f3162037700 1 -- 172.21.15.3:0/1022849443 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c0a2f50 con 0x7f315c06df30 2023-03-06T14:16:01.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.781+0000 7f3162037700 1 --2- 172.21.15.3:0/1022849443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f315c06df30 0x7f315c06e300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f315c06cc90 tx=0x7f314c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699fbe29467da770 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:01.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.781+0000 7f3161035700 1 -- 172.21.15.3:0/1022849443 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c011830 con 0x7f315c06df30 2023-03-06T14:16:01.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.781+0000 7f3161035700 1 -- 172.21.15.3:0/1022849443 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314c011990 con 0x7f315c06df30 2023-03-06T14:16:01.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.781+0000 7f3161035700 1 -- 172.21.15.3:0/1022849443 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c011d20 con 0x7f315c06df30 2023-03-06T14:16:01.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.781+0000 7f316429b700 1 -- 172.21.15.3:0/1022849443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f315c06df30 msgr2=0x7f315c06e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:01.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.781+0000 7f316429b700 1 --2- 172.21.15.3:0/1022849443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f315c06df30 0x7f315c06e300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f315c06cc90 tx=0x7f314c009c00 comp rx=0 tx=0).stop 2023-03-06T14:16:01.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.781+0000 7f316429b700 1 -- 172.21.15.3:0/1022849443 shutdown_connections 2023-03-06T14:16:01.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.781+0000 7f316429b700 1 --2- 172.21.15.3:0/1022849443 >> v2:172.21.15.136:3300/0 conn(0x7f315c0bdcc0 0x7f315c14fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:01.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.781+0000 7f316429b700 1 --2- 172.21.15.3:0/1022849443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f315c06df30 0x7f315c06e300 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:01.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.781+0000 7f316429b700 1 --2- 172.21.15.3:0/1022849443 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f315c06a2d0 0x7f315c14f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:01.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.781+0000 7f316429b700 1 -- 172.21.15.3:0/1022849443 >> 172.21.15.3:0/1022849443 conn(0x7f315c0c1790 msgr2=0x7f315c0c1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:01.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.781+0000 7f316429b700 1 -- 172.21.15.3:0/1022849443 shutdown_connections 2023-03-06T14:16:01.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.781+0000 7f316429b700 1 -- 172.21.15.3:0/1022849443 wait complete. 2023-03-06T14:16:01.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.783+0000 7f316429b700 1 Processor -- start 2023-03-06T14:16:01.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.783+0000 7f316429b700 1 -- start start 2023-03-06T14:16:01.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.783+0000 7f316429b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f315c06a2d0 0x7f315c144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:01.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.783+0000 7f316429b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f315c06df30 0x7f315c1364a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:01.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.783+0000 7f316429b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f315c0bdcc0 0x7f315c1e6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:01.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.783+0000 7f316429b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c1e3ea0 con 0x7f315c06df30 2023-03-06T14:16:01.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.783+0000 7f316429b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0b8390 con 0x7f315c0bdcc0 2023-03-06T14:16:01.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.783+0000 7f316429b700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0b6e80 con 0x7f315c06a2d0 2023-03-06T14:16:01.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.783+0000 7f3161836700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f315c06df30 0x7f315c1364a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:01.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.783+0000 7f3161836700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f315c06df30 0x7f315c1364a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55550/0 (socket says 172.21.15.3:55550) 2023-03-06T14:16:01.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.783+0000 7f3161836700 1 -- 172.21.15.3:0/4222690548 learned_addr learned my addr 172.21.15.3:0/4222690548 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:01.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.783+0000 7f3162838700 1 --2- 172.21.15.3:0/4222690548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f315c0bdcc0 0x7f315c1e6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:01.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.783+0000 7f3162037700 1 --2- 172.21.15.3:0/4222690548 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f315c06a2d0 0x7f315c144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:01.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.784+0000 7f3161836700 1 -- 172.21.15.3:0/4222690548 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f315c06a2d0 msgr2=0x7f315c144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:01.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.784+0000 7f3161836700 1 --2- 172.21.15.3:0/4222690548 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f315c06a2d0 0x7f315c144d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:01.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.784+0000 7f3161836700 1 -- 172.21.15.3:0/4222690548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f315c0bdcc0 msgr2=0x7f315c1e6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:01.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.784+0000 7f3161836700 1 --2- 172.21.15.3:0/4222690548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f315c0bdcc0 0x7f315c1e6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:01.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.784+0000 7f3161836700 1 -- 172.21.15.3:0/4222690548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c009550 con 0x7f315c06df30 2023-03-06T14:16:01.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.784+0000 7f3161836700 1 --2- 172.21.15.3:0/4222690548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f315c06df30 0x7f315c1364a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f315800e930 tx=0x7f315800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:01.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.784+0000 7f3152ffd700 1 -- 172.21.15.3:0/4222690548 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3158013680 con 0x7f315c06df30 2023-03-06T14:16:01.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.784+0000 7f3152ffd700 1 -- 172.21.15.3:0/4222690548 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31580137e0 con 0x7f315c06df30 2023-03-06T14:16:01.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.784+0000 7f316429b700 1 -- 172.21.15.3:0/4222690548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315c072900 con 0x7f315c06df30 2023-03-06T14:16:01.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.784+0000 7f3152ffd700 1 -- 172.21.15.3:0/4222690548 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3158013b70 con 0x7f315c06df30 2023-03-06T14:16:01.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.784+0000 7f316429b700 1 -- 172.21.15.3:0/4222690548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315c072620 con 0x7f315c06df30 2023-03-06T14:16:01.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.785+0000 7f316429b700 1 -- 172.21.15.3:0/4222690548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315c0bc640 con 0x7f315c06df30 2023-03-06T14:16:01.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.785+0000 7f3152ffd700 1 -- 172.21.15.3:0/4222690548 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3158019030 con 0x7f315c06df30 2023-03-06T14:16:01.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.786+0000 7f3152ffd700 1 --2- 172.21.15.3:0/4222690548 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3140068320 0x7f314006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:01.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.786+0000 7f3152ffd700 1 -- 172.21.15.3:0/4222690548 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f3158085d10 con 0x7f315c06df30 2023-03-06T14:16:01.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.786+0000 7f3162037700 1 --2- 172.21.15.3:0/4222690548 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3140068320 0x7f314006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:01.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.787+0000 7f3162037700 1 --2- 172.21.15.3:0/4222690548 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3140068320 0x7f314006a7d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f314c009870 tx=0x7f314c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:01.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.790+0000 7f3152ffd700 1 -- 172.21.15.3:0/4222690548 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f31580522a0 con 0x7f315c06df30 2023-03-06T14:16:01.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:01.983+0000 7f316429b700 1 -- 172.21.15.3:0/4222690548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f315c1e3c80 con 0x7f315c06df30 2023-03-06T14:16:02.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.620+0000 7f3152ffd700 1 -- 172.21.15.3:0/4222690548 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f31580558c0 con 0x7f315c06df30 2023-03-06T14:16:02.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.626+0000 7f316429b700 1 -- 172.21.15.3:0/4222690548 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3140068320 msgr2=0x7f314006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:02.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.626+0000 7f316429b700 1 --2- 172.21.15.3:0/4222690548 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3140068320 0x7f314006a7d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f314c009870 tx=0x7f314c008030 comp rx=0 tx=0).stop 2023-03-06T14:16:02.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.626+0000 7f316429b700 1 -- 172.21.15.3:0/4222690548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f315c06df30 msgr2=0x7f315c1364a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:02.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.626+0000 7f316429b700 1 --2- 172.21.15.3:0/4222690548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f315c06df30 0x7f315c1364a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f315800e930 tx=0x7f315800ec40 comp rx=0 tx=0).stop 2023-03-06T14:16:02.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.626+0000 7f316429b700 1 -- 172.21.15.3:0/4222690548 shutdown_connections 2023-03-06T14:16:02.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.626+0000 7f316429b700 1 --2- 172.21.15.3:0/4222690548 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3140068320 0x7f314006a7d0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f314c009870 tx=0x7f314c008030 comp rx=0 tx=0).stop 2023-03-06T14:16:02.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.626+0000 7f316429b700 1 --2- 172.21.15.3:0/4222690548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f315c0bdcc0 0x7f315c1e6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:02.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.626+0000 7f316429b700 1 --2- 172.21.15.3:0/4222690548 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f315c06a2d0 0x7f315c144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:02.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.626+0000 7f316429b700 1 --2- 172.21.15.3:0/4222690548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f315c06df30 0x7f315c1364a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:02.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.626+0000 7f316429b700 1 -- 172.21.15.3:0/4222690548 >> 172.21.15.3:0/4222690548 conn(0x7f315c0c1790 msgr2=0x7f315c0bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:02.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.629+0000 7f316429b700 1 -- 172.21.15.3:0/4222690548 shutdown_connections 2023-03-06T14:16:02.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.631+0000 7f316429b700 1 -- 172.21.15.3:0/4222690548 wait complete. 2023-03-06T14:16:02.637 INFO:teuthology.orchestra.run.smithi003.stderr:set pool 5 allow_ec_overwrites to true 2023-03-06T14:16:02.658 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-03-06T14:16:02.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.787+0000 7fb434ac7700 1 Processor -- start 2023-03-06T14:16:02.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.787+0000 7fb434ac7700 1 -- start start 2023-03-06T14:16:02.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.788+0000 7fb434ac7700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4300bc320 0x7fb4300c2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:02.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.788+0000 7fb434ac7700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb4300c28c0 0x7fb43006fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:02.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.788+0000 7fb434ac7700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4300c2d10 con 0x7fb4300701a0 2023-03-06T14:16:02.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.788+0000 7fb434ac7700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4300a2b20 con 0x7fb4300c28c0 2023-03-06T14:16:02.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.788+0000 7fb434ac7700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4300c1c20 con 0x7fb4300bc320 2023-03-06T14:16:02.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.788+0000 7fb42dd9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb4300c28c0 0x7fb43006fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:02.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.788+0000 7fb42dd9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb4300c28c0 0x7fb43006fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55556/0 (socket says 172.21.15.3:55556) 2023-03-06T14:16:02.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.788+0000 7fb42dd9b700 1 -- 172.21.15.3:0/830994903 learned_addr learned my addr 172.21.15.3:0/830994903 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:02.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.788+0000 7fb42e59c700 1 --2- 172.21.15.3:0/830994903 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4300bc320 0x7fb4300c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:02.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.789+0000 7fb42dd9b700 1 -- 172.21.15.3:0/830994903 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4300bc320 msgr2=0x7fb4300c2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:02.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.789+0000 7fb42dd9b700 1 --2- 172.21.15.3:0/830994903 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4300bc320 0x7fb4300c2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:02.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.789+0000 7fb42dd9b700 1 -- 172.21.15.3:0/830994903 >> v1:172.21.15.136:6789/0 conn(0x7fb4300701a0 legacy=0x7fb4300bdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:02.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.789+0000 7fb42dd9b700 1 -- 172.21.15.3:0/830994903 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb430070600 con 0x7fb4300c28c0 2023-03-06T14:16:02.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.789+0000 7fb42dd9b700 1 --2- 172.21.15.3:0/830994903 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4300c28c0 0x7fb43006fc60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb4200098f0 tx=0x7fb420009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee6672bd566bea9 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:02.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.789+0000 7fb42d59a700 1 -- 172.21.15.3:0/830994903 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb420004230 con 0x7fb4300c28c0 2023-03-06T14:16:02.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.789+0000 7fb42d59a700 1 -- 172.21.15.3:0/830994903 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb420004390 con 0x7fb4300c28c0 2023-03-06T14:16:02.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.789+0000 7fb42d59a700 1 -- 172.21.15.3:0/830994903 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4200036a0 con 0x7fb4300c28c0 2023-03-06T14:16:02.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.789+0000 7fb434ac7700 1 -- 172.21.15.3:0/830994903 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4300c28c0 msgr2=0x7fb43006fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:02.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.789+0000 7fb434ac7700 1 --2- 172.21.15.3:0/830994903 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4300c28c0 0x7fb43006fc60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb4200098f0 tx=0x7fb420009c00 comp rx=0 tx=0).stop 2023-03-06T14:16:02.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.789+0000 7fb434ac7700 1 -- 172.21.15.3:0/830994903 shutdown_connections 2023-03-06T14:16:02.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.790+0000 7fb434ac7700 1 --2- 172.21.15.3:0/830994903 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4300bc320 0x7fb4300c2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:02.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.790+0000 7fb434ac7700 1 --2- 172.21.15.3:0/830994903 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4300c28c0 0x7fb43006fc60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:02.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.790+0000 7fb434ac7700 1 -- 172.21.15.3:0/830994903 >> 172.21.15.3:0/830994903 conn(0x7fb4300c31d0 msgr2=0x7fb4300c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:02.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.790+0000 7fb434ac7700 1 -- 172.21.15.3:0/830994903 shutdown_connections 2023-03-06T14:16:02.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.790+0000 7fb434ac7700 1 -- 172.21.15.3:0/830994903 wait complete. 2023-03-06T14:16:02.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.791+0000 7fb434ac7700 1 Processor -- start 2023-03-06T14:16:02.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.791+0000 7fb434ac7700 1 -- start start 2023-03-06T14:16:02.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb434ac7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4300701a0 0x7fb4301e5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:02.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb434ac7700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4300bc320 0x7fb4301d8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:02.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb434ac7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4300c28c0 0x7fb4301e88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:02.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb434ac7700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4301e59c0 con 0x7fb4300701a0 2023-03-06T14:16:02.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb434ac7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4301e8450 con 0x7fb4300c28c0 2023-03-06T14:16:02.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb434ac7700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43006b240 con 0x7fb4300bc320 2023-03-06T14:16:02.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb42e59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4300701a0 0x7fb4301e5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:02.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb42e59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4300701a0 0x7fb4301e5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55562/0 (socket says 172.21.15.3:55562) 2023-03-06T14:16:02.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb42e59c700 1 -- 172.21.15.3:0/1434819863 learned_addr learned my addr 172.21.15.3:0/1434819863 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:02.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb42dd9b700 1 --2- 172.21.15.3:0/1434819863 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4300bc320 0x7fb4301d8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:02.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb42ed9d700 1 --2- 172.21.15.3:0/1434819863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4300c28c0 0x7fb4301e88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:02.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb42e59c700 1 -- 172.21.15.3:0/1434819863 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4300bc320 msgr2=0x7fb4301d8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:02.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb42e59c700 1 --2- 172.21.15.3:0/1434819863 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4300bc320 0x7fb4301d8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:02.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb42e59c700 1 -- 172.21.15.3:0/1434819863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4300c28c0 msgr2=0x7fb4301e88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:02.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb42e59c700 1 --2- 172.21.15.3:0/1434819863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4300c28c0 0x7fb4301e88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:02.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb42e59c700 1 -- 172.21.15.3:0/1434819863 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb420009550 con 0x7fb4300701a0 2023-03-06T14:16:02.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb42ed9d700 1 --2- 172.21.15.3:0/1434819863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4300c28c0 0x7fb4301e88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:02.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb42e59c700 1 --2- 172.21.15.3:0/1434819863 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4300701a0 0x7fb4301e5480 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb42400e840 tx=0x7fb42400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:02.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb41effd700 1 -- 172.21.15.3:0/1434819863 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb424013610 con 0x7fb4300701a0 2023-03-06T14:16:02.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb41effd700 1 -- 172.21.15.3:0/1434819863 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb424013770 con 0x7fb4300701a0 2023-03-06T14:16:02.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb434ac7700 1 -- 172.21.15.3:0/1434819863 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4300bec00 con 0x7fb4300701a0 2023-03-06T14:16:02.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb41effd700 1 -- 172.21.15.3:0/1434819863 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb424013b20 con 0x7fb4300701a0 2023-03-06T14:16:02.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.792+0000 7fb434ac7700 1 -- 172.21.15.3:0/1434819863 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4300beea0 con 0x7fb4300701a0 2023-03-06T14:16:02.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.794+0000 7fb434ac7700 1 -- 172.21.15.3:0/1434819863 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4300c18b0 con 0x7fb4300701a0 2023-03-06T14:16:02.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.794+0000 7fb41effd700 1 -- 172.21.15.3:0/1434819863 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb424023070 con 0x7fb4300701a0 2023-03-06T14:16:02.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.794+0000 7fb41effd700 1 --2- 172.21.15.3:0/1434819863 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb410068320 0x7fb41006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:02.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.794+0000 7fb41effd700 1 -- 172.21.15.3:0/1434819863 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fb424085c20 con 0x7fb4300701a0 2023-03-06T14:16:02.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.794+0000 7fb42dd9b700 1 --2- 172.21.15.3:0/1434819863 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb410068320 0x7fb41006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:02.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.795+0000 7fb42dd9b700 1 --2- 172.21.15.3:0/1434819863 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb410068320 0x7fb41006a7d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb420009130 tx=0x7fb420008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:02.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:02.798+0000 7fb41effd700 1 -- 172.21.15.3:0/1434819863 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb424052130 con 0x7fb4300701a0 2023-03-06T14:16:03.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.039+0000 7fb434ac7700 1 -- 172.21.15.3:0/1434819863 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fb4301d9260 con 0x7fb4300701a0 2023-03-06T14:16:03.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.046+0000 7fb41effd700 1 -- 172.21.15.3:0/1434819863 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fb42400f040 con 0x7fb4300701a0 2023-03-06T14:16:03.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.048+0000 7fb434ac7700 1 -- 172.21.15.3:0/1434819863 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb410068320 msgr2=0x7fb41006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.048+0000 7fb434ac7700 1 --2- 172.21.15.3:0/1434819863 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb410068320 0x7fb41006a7d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb420009130 tx=0x7fb420008030 comp rx=0 tx=0).stop 2023-03-06T14:16:03.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.048+0000 7fb434ac7700 1 -- 172.21.15.3:0/1434819863 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4300701a0 msgr2=0x7fb4301e5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.048+0000 7fb434ac7700 1 --2- 172.21.15.3:0/1434819863 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4300701a0 0x7fb4301e5480 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb42400e840 tx=0x7fb42400eb50 comp rx=0 tx=0).stop 2023-03-06T14:16:03.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.048+0000 7fb434ac7700 1 -- 172.21.15.3:0/1434819863 shutdown_connections 2023-03-06T14:16:03.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.048+0000 7fb434ac7700 1 --2- 172.21.15.3:0/1434819863 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb410068320 0x7fb41006a7d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.048+0000 7fb434ac7700 1 --2- 172.21.15.3:0/1434819863 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4300701a0 0x7fb4301e5480 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.048+0000 7fb434ac7700 1 --2- 172.21.15.3:0/1434819863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4300c28c0 0x7fb4301e88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.048+0000 7fb434ac7700 1 --2- 172.21.15.3:0/1434819863 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4300bc320 0x7fb4301d8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.048+0000 7fb434ac7700 1 -- 172.21.15.3:0/1434819863 >> 172.21.15.3:0/1434819863 conn(0x7fb4300c31d0 msgr2=0x7fb4300c0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:03.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.048+0000 7fb434ac7700 1 -- 172.21.15.3:0/1434819863 shutdown_connections 2023-03-06T14:16:03.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.048+0000 7fb434ac7700 1 -- 172.21.15.3:0/1434819863 wait complete. 2023-03-06T14:16:03.052 INFO:teuthology.orchestra.run.smithi003.stderr:added data pool 5 to fsmap 2023-03-06T14:16:03.061 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-06T14:16:03.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.187+0000 7fc0a48a0700 1 Processor -- start 2023-03-06T14:16:03.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.187+0000 7fc0a48a0700 1 -- start start 2023-03-06T14:16:03.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.188+0000 7fc0a48a0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc0a00b8140 0x7fc0a006e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:03.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.188+0000 7fc0a48a0700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a006fc80 con 0x7fc0a0146130 2023-03-06T14:16:03.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.188+0000 7fc0a48a0700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a014cb30 con 0x7fc0a006edd0 2023-03-06T14:16:03.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.188+0000 7fc0a48a0700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a006f520 con 0x7fc0a00b8140 2023-03-06T14:16:03.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.188+0000 7fc09dd9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc0a00b8140 0x7fc0a006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:03.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.188+0000 7fc09dd9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc0a00b8140 0x7fc0a006e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55572/0 (socket says 172.21.15.3:55572) 2023-03-06T14:16:03.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.188+0000 7fc09e59c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fc0a0146130 0x7fc0a014f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57842/0 (socket says 172.21.15.3:57842) 2023-03-06T14:16:03.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.188+0000 7fc09dd9b700 1 -- 172.21.15.3:0/2265817412 learned_addr learned my addr 172.21.15.3:0/2265817412 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:03.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.188+0000 7fc09dd9b700 1 -- 172.21.15.3:0/2265817412 >> v1:172.21.15.136:6789/0 conn(0x7fc0a006edd0 legacy=0x7fc0a0156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.188+0000 7fc09dd9b700 1 -- 172.21.15.3:0/2265817412 >> v1:172.21.15.3:6789/0 conn(0x7fc0a0146130 legacy=0x7fc0a014f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.188+0000 7fc09dd9b700 1 -- 172.21.15.3:0/2265817412 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a006f9a0 con 0x7fc0a00b8140 2023-03-06T14:16:03.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.188+0000 7fc09dd9b700 1 --2- 172.21.15.3:0/2265817412 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0a00b8140 0x7fc0a006e890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc0900098f0 tx=0x7fc090009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff89736333f6b5c server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:03.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.189+0000 7fc09d59a700 1 -- 172.21.15.3:0/2265817412 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09000b8a0 con 0x7fc0a00b8140 2023-03-06T14:16:03.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.189+0000 7fc09d59a700 1 -- 172.21.15.3:0/2265817412 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09000ba00 con 0x7fc0a00b8140 2023-03-06T14:16:03.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.189+0000 7fc09d59a700 1 -- 172.21.15.3:0/2265817412 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09000bd90 con 0x7fc0a00b8140 2023-03-06T14:16:03.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.189+0000 7fc0a48a0700 1 -- 172.21.15.3:0/2265817412 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0a00b8140 msgr2=0x7fc0a006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.189+0000 7fc0a48a0700 1 --2- 172.21.15.3:0/2265817412 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0a00b8140 0x7fc0a006e890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc0900098f0 tx=0x7fc090009c00 comp rx=0 tx=0).stop 2023-03-06T14:16:03.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.189+0000 7fc0a48a0700 1 -- 172.21.15.3:0/2265817412 shutdown_connections 2023-03-06T14:16:03.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.189+0000 7fc0a48a0700 1 --2- 172.21.15.3:0/2265817412 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0a00b8140 0x7fc0a006e890 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.189+0000 7fc0a48a0700 1 -- 172.21.15.3:0/2265817412 >> 172.21.15.3:0/2265817412 conn(0x7fc0a00c2150 msgr2=0x7fc0a00c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:03.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.189+0000 7fc0a48a0700 1 -- 172.21.15.3:0/2265817412 shutdown_connections 2023-03-06T14:16:03.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.189+0000 7fc0a48a0700 1 -- 172.21.15.3:0/2265817412 wait complete. 2023-03-06T14:16:03.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.191+0000 7fc0a48a0700 1 Processor -- start 2023-03-06T14:16:03.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.191+0000 7fc0a48a0700 1 -- start start 2023-03-06T14:16:03.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.191+0000 7fc0a48a0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0a006edd0 0x7fc0a006add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:03.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.191+0000 7fc0a48a0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0a00b8140 0x7fc0a01e7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:03.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.191+0000 7fc0a48a0700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0a0146130 0x7fc0a01e8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:03.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.191+0000 7fc0a48a0700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a01e5570 con 0x7fc0a006edd0 2023-03-06T14:16:03.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.191+0000 7fc0a48a0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a006d450 con 0x7fc0a00b8140 2023-03-06T14:16:03.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.191+0000 7fc0a48a0700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a006b310 con 0x7fc0a0146130 2023-03-06T14:16:03.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.191+0000 7fc09e59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0a006edd0 0x7fc0a006add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:03.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.191+0000 7fc09e59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0a006edd0 0x7fc0a006add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55576/0 (socket says 172.21.15.3:55576) 2023-03-06T14:16:03.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.191+0000 7fc09e59c700 1 -- 172.21.15.3:0/3463653870 learned_addr learned my addr 172.21.15.3:0/3463653870 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:03.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.192+0000 7fc09e59c700 1 -- 172.21.15.3:0/3463653870 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0a0146130 msgr2=0x7fc0a01e8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.192+0000 7fc09dd9b700 1 --2- 172.21.15.3:0/3463653870 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0a00b8140 0x7fc0a01e7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:03.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.192+0000 7fc09e59c700 1 --2- 172.21.15.3:0/3463653870 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0a0146130 0x7fc0a01e8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.192+0000 7fc09e59c700 1 -- 172.21.15.3:0/3463653870 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0a00b8140 msgr2=0x7fc0a01e7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.192+0000 7fc09e59c700 1 --2- 172.21.15.3:0/3463653870 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0a00b8140 0x7fc0a01e7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.192+0000 7fc09e59c700 1 -- 172.21.15.3:0/3463653870 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc090009550 con 0x7fc0a006edd0 2023-03-06T14:16:03.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.192+0000 7fc09e59c700 1 --2- 172.21.15.3:0/3463653870 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0a006edd0 0x7fc0a006add0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc09400c4e0 tx=0x7fc09400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:03.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.192+0000 7fc08effd700 1 -- 172.21.15.3:0/3463653870 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0940074e0 con 0x7fc0a006edd0 2023-03-06T14:16:03.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.192+0000 7fc08effd700 1 -- 172.21.15.3:0/3463653870 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc094007640 con 0x7fc0a006edd0 2023-03-06T14:16:03.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.192+0000 7fc0a48a0700 1 -- 172.21.15.3:0/3463653870 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a00b8b50 con 0x7fc0a006edd0 2023-03-06T14:16:03.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.192+0000 7fc08effd700 1 -- 172.21.15.3:0/3463653870 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094005a70 con 0x7fc0a006edd0 2023-03-06T14:16:03.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.192+0000 7fc0a48a0700 1 -- 172.21.15.3:0/3463653870 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a00b8870 con 0x7fc0a006edd0 2023-03-06T14:16:03.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.193+0000 7fc0a48a0700 1 -- 172.21.15.3:0/3463653870 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a00b7110 con 0x7fc0a006edd0 2023-03-06T14:16:03.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.194+0000 7fc08effd700 1 -- 172.21.15.3:0/3463653870 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc094019030 con 0x7fc0a006edd0 2023-03-06T14:16:03.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.194+0000 7fc08effd700 1 --2- 172.21.15.3:0/3463653870 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0800682f0 0x7fc08006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:03.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.194+0000 7fc08effd700 1 -- 172.21.15.3:0/3463653870 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc094085320 con 0x7fc0a006edd0 2023-03-06T14:16:03.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.194+0000 7fc09dd9b700 1 --2- 172.21.15.3:0/3463653870 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0800682f0 0x7fc08006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:03.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.195+0000 7fc09dd9b700 1 --2- 172.21.15.3:0/3463653870 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0800682f0 0x7fc08006a7a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc0a006e430 tx=0x7fc090008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:03.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.198+0000 7fc08effd700 1 -- 172.21.15.3:0/3463653870 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc094051830 con 0x7fc0a006edd0 2023-03-06T14:16:03.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.437+0000 7fc0a48a0700 1 -- 172.21.15.3:0/3463653870 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0a01e7b10 con 0x7fc0a006edd0 2023-03-06T14:16:03.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.437+0000 7fc08effd700 1 -- 172.21.15.3:0/3463653870 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4644 (secure 0 0 0) 0x7fc0a01e7b10 con 0x7fc0a006edd0 2023-03-06T14:16:03.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:03.439 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/3666647721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3666647721},{"type":"v1","addr":"172.21.15.136:6835","nonce":3666647721}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6834/1347040159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":1347040159},{"type":"v1","addr":"172.21.15.3:6834","nonce":1347040159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2387644382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2387644382},{"type":"v1","addr":"172.21.15.136:6837","nonce":2387644382}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-06T14:15:58.597248+0000","modified":"2023-03-06T14:16:03.040620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6835/3655666630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6833","nonce":3655666630},{"type":"v1","addr":"172.21.15.3:6835","nonce":3655666630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-03-06T14:16:03.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.439+0000 7fc0a48a0700 1 -- 172.21.15.3:0/3463653870 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0800682f0 msgr2=0x7fc08006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.439+0000 7fc0a48a0700 1 --2- 172.21.15.3:0/3463653870 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0800682f0 0x7fc08006a7a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc0a006e430 tx=0x7fc090008030 comp rx=0 tx=0).stop 2023-03-06T14:16:03.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.439+0000 7fc0a48a0700 1 -- 172.21.15.3:0/3463653870 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0a006edd0 msgr2=0x7fc0a006add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.439+0000 7fc0a48a0700 1 --2- 172.21.15.3:0/3463653870 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0a006edd0 0x7fc0a006add0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc09400c4e0 tx=0x7fc09400c8a0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.439+0000 7fc0a48a0700 1 -- 172.21.15.3:0/3463653870 shutdown_connections 2023-03-06T14:16:03.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.439+0000 7fc0a48a0700 1 --2- 172.21.15.3:0/3463653870 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0800682f0 0x7fc08006a7a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.439+0000 7fc0a48a0700 1 --2- 172.21.15.3:0/3463653870 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0a006edd0 0x7fc0a006add0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.439+0000 7fc0a48a0700 1 --2- 172.21.15.3:0/3463653870 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0a0146130 0x7fc0a01e8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.439+0000 7fc0a48a0700 1 --2- 172.21.15.3:0/3463653870 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0a00b8140 0x7fc0a01e7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.439+0000 7fc0a48a0700 1 -- 172.21.15.3:0/3463653870 >> 172.21.15.3:0/3463653870 conn(0x7fc0a00c2150 msgr2=0x7fc0a00c0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:03.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.439+0000 7fc0a48a0700 1 -- 172.21.15.3:0/3463653870 shutdown_connections 2023-03-06T14:16:03.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.439+0000 7fc0a48a0700 1 -- 172.21.15.3:0/3463653870 wait complete. 2023-03-06T14:16:03.443 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 7 2023-03-06T14:16:03.453 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T14:16:03.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.576+0000 7f979f2b8700 1 Processor -- start 2023-03-06T14:16:03.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.577+0000 7f979f2b8700 1 -- start start 2023-03-06T14:16:03.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.577+0000 7f979f2b8700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f979806ea70 0x7f97980bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:03.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.577+0000 7f979f2b8700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979814ff80 con 0x7f97980bdd60 2023-03-06T14:16:03.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.577+0000 7f979f2b8700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97980bcb90 con 0x7f979806ee40 2023-03-06T14:16:03.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.577+0000 7f979f2b8700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97980b9070 con 0x7f979806ea70 2023-03-06T14:16:03.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f979d855700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f97980bdd60 0x7f979806c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57860/0 (socket says 172.21.15.3:57860) 2023-03-06T14:16:03.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f979d855700 1 -- 172.21.15.3:0/3323269021 learned_addr learned my addr 172.21.15.3:0/3323269021 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:03.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f979d054700 1 --2- 172.21.15.3:0/3323269021 >> v2:172.21.15.136:3300/0 conn(0x7f979806ea70 0x7f97980bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:03.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f978bfff700 1 -- 172.21.15.3:0/3323269021 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971896031 0 0) 0x7f979814ff80 con 0x7f97980bdd60 2023-03-06T14:16:03.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f978bfff700 1 -- 172.21.15.3:0/3323269021 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97840035b0 con 0x7f97980bdd60 2023-03-06T14:16:03.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f978bfff700 1 -- 172.21.15.3:0/3323269021 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3294132775 0 0) 0x7f97840035b0 con 0x7f97980bdd60 2023-03-06T14:16:03.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f978bfff700 1 -- 172.21.15.3:0/3323269021 >> v2:172.21.15.136:3300/0 conn(0x7f979806ea70 msgr2=0x7f97980bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:03.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f978bfff700 1 --2- 172.21.15.3:0/3323269021 >> v2:172.21.15.136:3300/0 conn(0x7f979806ea70 0x7f97980bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f978bfff700 1 -- 172.21.15.3:0/3323269021 >> v1:172.21.15.136:6789/0 conn(0x7f979806ee40 legacy=0x7f97981490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f978bfff700 1 -- 172.21.15.3:0/3323269021 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97980bce70 con 0x7f97980bdd60 2023-03-06T14:16:03.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f978bfff700 1 -- 172.21.15.3:0/3323269021 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3255535284 0 0) 0x7f97900019f0 con 0x7f97980bdd60 2023-03-06T14:16:03.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f978bfff700 1 -- 172.21.15.3:0/3323269021 >> v1:172.21.15.3:6789/0 conn(0x7f97980bdd60 legacy=0x7f979806c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f978bfff700 1 --2- 172.21.15.3:0/3323269021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9784003a00 0x7f9784003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:03.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f978bfff700 1 --2- 172.21.15.3:0/3323269021 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97840043f0 0x7f97840048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:03.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f978bfff700 1 --2- 172.21.15.3:0/3323269021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97840050b0 0x7f978400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:03.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f978bfff700 1 -- 172.21.15.3:0/3323269021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978400c000 con 0x7f97840050b0 2023-03-06T14:16:03.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f978bfff700 1 -- 172.21.15.3:0/3323269021 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978400c140 con 0x7f9784003a00 2023-03-06T14:16:03.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f978bfff700 1 -- 172.21.15.3:0/3323269021 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978400c300 con 0x7f97840043f0 2023-03-06T14:16:03.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f979d855700 1 --2- 172.21.15.3:0/3323269021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97840050b0 0x7f978400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:03.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f979d054700 1 --2- 172.21.15.3:0/3323269021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9784003a00 0x7f9784003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:03.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.578+0000 7f979c853700 1 --2- 172.21.15.3:0/3323269021 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97840043f0 0x7f97840048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:03.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.579+0000 7f979d855700 1 -- 172.21.15.3:0/3323269021 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97840043f0 msgr2=0x7f97840048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:03.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.579+0000 7f979d855700 1 --2- 172.21.15.3:0/3323269021 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97840043f0 0x7f97840048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.579+0000 7f979d855700 1 -- 172.21.15.3:0/3323269021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9784003a00 msgr2=0x7f9784003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:03.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.579+0000 7f979d855700 1 --2- 172.21.15.3:0/3323269021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9784003a00 0x7f9784003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.579+0000 7f979d855700 1 -- 172.21.15.3:0/3323269021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97840035b0 con 0x7f97840050b0 2023-03-06T14:16:03.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.579+0000 7f979c853700 1 --2- 172.21.15.3:0/3323269021 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97840043f0 0x7f97840048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:03.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.579+0000 7f979d855700 1 -- 172.21.15.3:0/3323269021 reap_dead start 2023-03-06T14:16:03.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.579+0000 7f979d855700 1 --2- 172.21.15.3:0/3323269021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97840050b0 0x7f978400ba10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f979000a810 tx=0x7f9784005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd96096e14361bb2 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:03.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.579+0000 7f978bfff700 1 -- 172.21.15.3:0/3323269021 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790012600 con 0x7f97840050b0 2023-03-06T14:16:03.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.579+0000 7f978bfff700 1 -- 172.21.15.3:0/3323269021 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9790012780 con 0x7f97840050b0 2023-03-06T14:16:03.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.579+0000 7f978bfff700 1 -- 172.21.15.3:0/3323269021 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790012b30 con 0x7f97840050b0 2023-03-06T14:16:03.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.579+0000 7f979f2b8700 1 -- 172.21.15.3:0/3323269021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97840050b0 msgr2=0x7f978400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.579+0000 7f979f2b8700 1 --2- 172.21.15.3:0/3323269021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97840050b0 0x7f978400ba10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f979000a810 tx=0x7f9784005880 comp rx=0 tx=0).stop 2023-03-06T14:16:03.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.579+0000 7f979f2b8700 1 -- 172.21.15.3:0/3323269021 shutdown_connections 2023-03-06T14:16:03.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.579+0000 7f979f2b8700 1 --2- 172.21.15.3:0/3323269021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97840050b0 0x7f978400ba10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.579+0000 7f979f2b8700 1 -- 172.21.15.3:0/3323269021 >> 172.21.15.3:0/3323269021 conn(0x7f97980c2150 msgr2=0x7f97980c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:03.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.579+0000 7f979f2b8700 1 -- 172.21.15.3:0/3323269021 shutdown_connections 2023-03-06T14:16:03.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.579+0000 7f979f2b8700 1 -- 172.21.15.3:0/3323269021 wait complete. 2023-03-06T14:16:03.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.581+0000 7f979f2b8700 1 Processor -- start 2023-03-06T14:16:03.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.581+0000 7f979f2b8700 1 -- start start 2023-03-06T14:16:03.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.582+0000 7f979f2b8700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97840050b0 0x7f9798152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:03.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.582+0000 7f979f2b8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97980a62c0 0x7f97980a7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:03.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.582+0000 7f979f2b8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97980a7db0 0x7f97981e7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:03.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.582+0000 7f979f2b8700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97980a5730 con 0x7f97980a7db0 2023-03-06T14:16:03.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.582+0000 7f979f2b8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9798152900 con 0x7f97980a62c0 2023-03-06T14:16:03.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.582+0000 7f979f2b8700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97981532d0 con 0x7f97840050b0 2023-03-06T14:16:03.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.582+0000 7f979d855700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97980a7db0 0x7f97981e7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:03.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.582+0000 7f979d855700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97980a7db0 0x7f97981e7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55600/0 (socket says 172.21.15.3:55600) 2023-03-06T14:16:03.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.582+0000 7f979d855700 1 -- 172.21.15.3:0/2333588184 learned_addr learned my addr 172.21.15.3:0/2333588184 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:03.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.582+0000 7f979d054700 1 --2- 172.21.15.3:0/2333588184 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97840050b0 0x7f9798152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:03.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.582+0000 7f979c853700 1 --2- 172.21.15.3:0/2333588184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97980a62c0 0x7f97980a7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:03.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.582+0000 7f979d855700 1 -- 172.21.15.3:0/2333588184 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97840050b0 msgr2=0x7f9798152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.582+0000 7f979d855700 1 --2- 172.21.15.3:0/2333588184 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97840050b0 0x7f9798152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.582+0000 7f979d855700 1 -- 172.21.15.3:0/2333588184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97980a62c0 msgr2=0x7f97980a7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.582+0000 7f979d855700 1 --2- 172.21.15.3:0/2333588184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97980a62c0 0x7f97980a7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.582+0000 7f979d855700 1 -- 172.21.15.3:0/2333588184 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9798150220 con 0x7f97980a7db0 2023-03-06T14:16:03.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.582+0000 7f979d054700 1 --2- 172.21.15.3:0/2333588184 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97840050b0 0x7f9798152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:16:03.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.582+0000 7f979c853700 1 --2- 172.21.15.3:0/2333588184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97980a62c0 0x7f97980a7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:16:03.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.582+0000 7f979d855700 1 --2- 172.21.15.3:0/2333588184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97980a7db0 0x7f97981e7a80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f979000afd0 tx=0x7f979806b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:03.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.583+0000 7f9789ffb700 1 -- 172.21.15.3:0/2333588184 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979001d620 con 0x7f97980a7db0 2023-03-06T14:16:03.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.583+0000 7f9789ffb700 1 -- 172.21.15.3:0/2333588184 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979001d780 con 0x7f97980a7db0 2023-03-06T14:16:03.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.583+0000 7f979f2b8700 1 -- 172.21.15.3:0/2333588184 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97980bd150 con 0x7f97980a7db0 2023-03-06T14:16:03.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.583+0000 7f9789ffb700 1 -- 172.21.15.3:0/2333588184 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979001db30 con 0x7f97980a7db0 2023-03-06T14:16:03.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.583+0000 7f979f2b8700 1 -- 172.21.15.3:0/2333588184 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97980b8b80 con 0x7f97980a7db0 2023-03-06T14:16:03.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.584+0000 7f979f2b8700 1 -- 172.21.15.3:0/2333588184 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979814f140 con 0x7f97980a7db0 2023-03-06T14:16:03.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.584+0000 7f9789ffb700 1 -- 172.21.15.3:0/2333588184 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9790010070 con 0x7f97980a7db0 2023-03-06T14:16:03.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.585+0000 7f9789ffb700 1 --2- 172.21.15.3:0/2333588184 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f977c0682f0 0x7f977c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:03.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.585+0000 7f9789ffb700 1 -- 172.21.15.3:0/2333588184 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9790087ff0 con 0x7f97980a7db0 2023-03-06T14:16:03.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.585+0000 7f979d054700 1 --2- 172.21.15.3:0/2333588184 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f977c0682f0 0x7f977c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:03.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.586+0000 7f979d054700 1 --2- 172.21.15.3:0/2333588184 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f977c0682f0 0x7f977c06a7a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9794009400 tx=0x7f9794008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:03.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.589+0000 7f9789ffb700 1 -- 172.21.15.3:0/2333588184 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9790054560 con 0x7f97980a7db0 2023-03-06T14:16:03.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.783+0000 7f979f2b8700 1 -- 172.21.15.3:0/2333588184 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9798152a40 con 0x7f97980a7db0 2023-03-06T14:16:03.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.785+0000 7f9789ffb700 1 -- 172.21.15.3:0/2333588184 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19604 (secure 0 0 0) 0x7f9790057b80 con 0x7f97980a7db0 2023-03-06T14:16:03.786 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:03.786 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":27,"fsid":"9aae2361-5af0-49eb-8f99-e7f69834fedf","created":"2023-03-06T14:15:33.357348+0000","modified":"2023-03-06T14:16:03.040402+0000","last_up_change":"2023-03-06T14:15:44.374764+0000","last_in_change":"2023-03-06T14:15:35.866803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T14:15:45.023761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T14:15:51.830917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-06T14:15:56.256188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-06T14:15:57.571429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-06T14:16:00.645210+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c92c9e49-8a23-48a5-87e5-51f184f73a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":96679},{"type":"v1","addr":"172.21.15.3:6809","nonce":96679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":96679},{"type":"v1","addr":"172.21.15.3:6811","nonce":96679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":96679},{"type":"v1","addr":"172.21.15.3:6818","nonce":96679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":96679},{"type":"v1","addr":"172.21.15.3:6814","nonce":96679}]},"public_addr":"172.21.15.3:6809/96679","cluster_addr":"172.21.15.3:6811/96679","heartbeat_back_addr":"172.21.15.3:6818/96679","heartbeat_front_addr":"172.21.15.3:6814/96679","state":["exists","up"]},{"osd":1,"uuid":"86ec9127-843f-4246-bfbe-e14ce3af7d17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":96681},{"type":"v1","addr":"172.21.15.3:6825","nonce":96681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":96681},{"type":"v1","addr":"172.21.15.3:6827","nonce":96681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":96681},{"type":"v1","addr":"172.21.15.3:6831","nonce":96681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":96681},{"type":"v1","addr":"172.21.15.3:6829","nonce":96681}]},"public_addr":"172.21.15.3:6825/96681","cluster_addr":"172.21.15.3:6827/96681","heartbeat_back_addr":"172.21.15.3:6831/96681","heartbeat_front_addr":"172.21.15.3:6829/96681","state":["exists","up"]},{"osd":2,"uuid":"67582de3-0f75-4cf0-84ca-e878986f99f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":96682},{"type":"v1","addr":"172.21.15.3:6815","nonce":96682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6817","nonce":96682},{"type":"v1","addr":"172.21.15.3:6819","nonce":96682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":96682},{"type":"v1","addr":"172.21.15.3:6823","nonce":96682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":96682},{"type":"v1","addr":"172.21.15.3:6821","nonce":96682}]},"public_addr":"172.21.15.3:6815/96682","cluster_addr":"172.21.15.3:6819/96682","heartbeat_back_addr":"172.21.15.3:6823/96682","heartbeat_front_addr":"172.21.15.3:6821/96682","state":["exists","up"]},{"osd":3,"uuid":"0fb8d708-4b38-4153-8a60-79741765d439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":96680},{"type":"v1","addr":"172.21.15.3:6801","nonce":96680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":96680},{"type":"v1","addr":"172.21.15.3:6803","nonce":96680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":96680},{"type":"v1","addr":"172.21.15.3:6807","nonce":96680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":96680},{"type":"v1","addr":"172.21.15.3:6805","nonce":96680}]},"public_addr":"172.21.15.3:6801/96680","cluster_addr":"172.21.15.3:6803/96680","heartbeat_back_addr":"172.21.15.3:6807/96680","heartbeat_front_addr":"172.21.15.3:6805/96680","state":["exists","up"]},{"osd":4,"uuid":"44eb9d99-975f-43a3-8bf4-213b2ba6dea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":96798},{"type":"v1","addr":"172.21.15.136:6822","nonce":96798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":96798},{"type":"v1","addr":"172.21.15.136:6826","nonce":96798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":96798},{"type":"v1","addr":"172.21.15.136:6831","nonce":96798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":96798},{"type":"v1","addr":"172.21.15.136:6829","nonce":96798}]},"public_addr":"172.21.15.136:6822/96798","cluster_addr":"172.21.15.136:6826/96798","heartbeat_back_addr":"172.21.15.136:6831/96798","heartbeat_front_addr":"172.21.15.136:6829/96798","state":["exists","up"]},{"osd":5,"uuid":"aff1a438-c444-4ebc-9806-d2d117878a2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":96796},{"type":"v1","addr":"172.21.15.136:6804","nonce":96796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":96796},{"type":"v1","addr":"172.21.15.136:6809","nonce":96796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":96796},{"type":"v1","addr":"172.21.15.136:6815","nonce":96796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":96796},{"type":"v1","addr":"172.21.15.136:6813","nonce":96796}]},"public_addr":"172.21.15.136:6804/96796","cluster_addr":"172.21.15.136:6809/96796","heartbeat_back_addr":"172.21.15.136:6815/96796","heartbeat_front_addr":"172.21.15.136:6813/96796","state":["exists","up"]},{"osd":6,"uuid":"89cc219c-f57b-43f4-8e54-76017dd4930d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":96797},{"type":"v1","addr":"172.21.15.136:6801","nonce":96797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6803","nonce":96797},{"type":"v1","addr":"172.21.15.136:6805","nonce":96797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":96797},{"type":"v1","addr":"172.21.15.136:6811","nonce":96797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":96797},{"type":"v1","addr":"172.21.15.136:6808","nonce":96797}]},"public_addr":"172.21.15.136:6801/96797","cluster_addr":"172.21.15.136:6805/96797","heartbeat_back_addr":"172.21.15.136:6811/96797","heartbeat_front_addr":"172.21.15.136:6808/96797","state":["exists","up"]},{"osd":7,"uuid":"a90e4c14-00de-4d1c-92ce-9f20df714e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":96819},{"type":"v1","addr":"172.21.15.136:6817","nonce":96819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":96819},{"type":"v1","addr":"172.21.15.136:6819","nonce":96819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":96819},{"type":"v1","addr":"172.21.15.136:6827","nonce":96819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":96819},{"type":"v1","addr":"172.21.15.136:6823","nonce":96819}]},"public_addr":"172.21.15.136:6817/96819","cluster_addr":"172.21.15.136:6819/96819","heartbeat_back_addr":"172.21.15.136:6827/96819","heartbeat_front_addr":"172.21.15.136:6823/96819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.093141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.034488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.128137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.097924+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.045441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.005820+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.039918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.082053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T14:16:03.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.787+0000 7f979f2b8700 1 -- 172.21.15.3:0/2333588184 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f977c0682f0 msgr2=0x7f977c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.787+0000 7f979f2b8700 1 --2- 172.21.15.3:0/2333588184 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f977c0682f0 0x7f977c06a7a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9794009400 tx=0x7f9794008040 comp rx=0 tx=0).stop 2023-03-06T14:16:03.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.787+0000 7f979f2b8700 1 -- 172.21.15.3:0/2333588184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97980a7db0 msgr2=0x7f97981e7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.787+0000 7f979f2b8700 1 --2- 172.21.15.3:0/2333588184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97980a7db0 0x7f97981e7a80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f979000afd0 tx=0x7f979806b790 comp rx=0 tx=0).stop 2023-03-06T14:16:03.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.787+0000 7f979f2b8700 1 -- 172.21.15.3:0/2333588184 shutdown_connections 2023-03-06T14:16:03.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.787+0000 7f979f2b8700 1 --2- 172.21.15.3:0/2333588184 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f977c0682f0 0x7f977c06a7a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.787+0000 7f979f2b8700 1 --2- 172.21.15.3:0/2333588184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97980a7db0 0x7f97981e7a80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.787+0000 7f979f2b8700 1 --2- 172.21.15.3:0/2333588184 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97840050b0 0x7f9798152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.787+0000 7f979f2b8700 1 --2- 172.21.15.3:0/2333588184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97980a62c0 0x7f97980a7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.787+0000 7f979f2b8700 1 -- 172.21.15.3:0/2333588184 >> 172.21.15.3:0/2333588184 conn(0x7f97980c2150 msgr2=0x7f979806cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:03.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.787+0000 7f979f2b8700 1 -- 172.21.15.3:0/2333588184 shutdown_connections 2023-03-06T14:16:03.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.787+0000 7f979f2b8700 1 -- 172.21.15.3:0/2333588184 wait complete. 2023-03-06T14:16:03.800 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T14:16:03.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.924+0000 7f4e7dd86700 1 Processor -- start 2023-03-06T14:16:03.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.924+0000 7f4e7dd86700 1 -- start start 2023-03-06T14:16:03.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.925+0000 7f4e7dd86700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e780bf4f0 0x7f4e780c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:03.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.925+0000 7f4e7dd86700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4e780c1160 0x7f4e780c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:03.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.925+0000 7f4e7dd86700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e780c29e0 con 0x7f4e781491d0 2023-03-06T14:16:03.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.925+0000 7f4e7dd86700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e780be680 con 0x7f4e780c1160 2023-03-06T14:16:03.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.925+0000 7f4e7dd86700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e781495a0 con 0x7f4e780bf4f0 2023-03-06T14:16:03.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.925+0000 7f4e77fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4e780c1160 0x7f4e780c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:03.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.925+0000 7f4e77fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4e780c1160 0x7f4e780c20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55608/0 (socket says 172.21.15.3:55608) 2023-03-06T14:16:03.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.925+0000 7f4e77fff700 1 -- 172.21.15.3:0/2930052782 learned_addr learned my addr 172.21.15.3:0/2930052782 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:03.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.925+0000 7f4e76ffd700 1 --2- 172.21.15.3:0/2930052782 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e780bf4f0 0x7f4e780c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:03.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.925+0000 7f4e77fff700 1 -- 172.21.15.3:0/2930052782 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e780bf4f0 msgr2=0x7f4e780c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:03.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.925+0000 7f4e77fff700 1 --2- 172.21.15.3:0/2930052782 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e780bf4f0 0x7f4e780c1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.925+0000 7f4e77fff700 1 -- 172.21.15.3:0/2930052782 >> v1:172.21.15.136:6789/0 conn(0x7f4e781491d0 legacy=0x7f4e780c05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.925+0000 7f4e77fff700 1 -- 172.21.15.3:0/2930052782 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e780c2600 con 0x7f4e780c1160 2023-03-06T14:16:03.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.925+0000 7f4e77fff700 1 --2- 172.21.15.3:0/2930052782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e780c1160 0x7f4e780c20c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009e50 tx=0x7f4e7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d8ed17ea0a948e server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:03.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.925+0000 7f4e767fc700 1 -- 172.21.15.3:0/2930052782 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7000e070 con 0x7f4e780c1160 2023-03-06T14:16:03.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.926+0000 7f4e767fc700 1 -- 172.21.15.3:0/2930052782 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7000b9c0 con 0x7f4e780c1160 2023-03-06T14:16:03.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.926+0000 7f4e767fc700 1 -- 172.21.15.3:0/2930052782 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7000bd70 con 0x7f4e780c1160 2023-03-06T14:16:03.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.926+0000 7f4e7dd86700 1 -- 172.21.15.3:0/2930052782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e780c1160 msgr2=0x7f4e780c20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.926+0000 7f4e7dd86700 1 --2- 172.21.15.3:0/2930052782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e780c1160 0x7f4e780c20c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009e50 tx=0x7f4e7000b330 comp rx=0 tx=0).stop 2023-03-06T14:16:03.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.926+0000 7f4e7dd86700 1 -- 172.21.15.3:0/2930052782 shutdown_connections 2023-03-06T14:16:03.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.926+0000 7f4e7dd86700 1 --2- 172.21.15.3:0/2930052782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e780c1160 0x7f4e780c20c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.926+0000 7f4e7dd86700 1 --2- 172.21.15.3:0/2930052782 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e780bf4f0 0x7f4e780c1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.926+0000 7f4e7dd86700 1 -- 172.21.15.3:0/2930052782 >> 172.21.15.3:0/2930052782 conn(0x7f4e7806a2d0 msgr2=0x7f4e7806a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:03.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.926+0000 7f4e7dd86700 1 -- 172.21.15.3:0/2930052782 shutdown_connections 2023-03-06T14:16:03.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.926+0000 7f4e7dd86700 1 -- 172.21.15.3:0/2930052782 wait complete. 2023-03-06T14:16:03.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.928+0000 7f4e7dd86700 1 Processor -- start 2023-03-06T14:16:03.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.928+0000 7f4e7dd86700 1 -- start start 2023-03-06T14:16:03.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e7dd86700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e780bf4f0 0x7f4e780b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:03.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e7dd86700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e780c1160 0x7f4e7814a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:03.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e7dd86700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e781491d0 0x7f4e781daaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:03.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e7dd86700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7814d770 con 0x7f4e780c1160 2023-03-06T14:16:03.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e7dd86700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e781da660 con 0x7f4e781491d0 2023-03-06T14:16:03.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e7dd86700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7814b560 con 0x7f4e780bf4f0 2023-03-06T14:16:03.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e76ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e780c1160 0x7f4e7814a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:03.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e76ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e780c1160 0x7f4e7814a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55612/0 (socket says 172.21.15.3:55612) 2023-03-06T14:16:03.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e76ffd700 1 -- 172.21.15.3:0/3306435895 learned_addr learned my addr 172.21.15.3:0/3306435895 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:03.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e777fe700 1 --2- 172.21.15.3:0/3306435895 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e780bf4f0 0x7f4e780b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:03.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e77fff700 1 --2- 172.21.15.3:0/3306435895 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e781491d0 0x7f4e781daaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:03.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e76ffd700 1 -- 172.21.15.3:0/3306435895 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e780bf4f0 msgr2=0x7f4e780b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e76ffd700 1 --2- 172.21.15.3:0/3306435895 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e780bf4f0 0x7f4e780b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e76ffd700 1 -- 172.21.15.3:0/3306435895 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e781491d0 msgr2=0x7f4e781daaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:03.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e76ffd700 1 --2- 172.21.15.3:0/3306435895 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e781491d0 0x7f4e781daaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:03.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e76ffd700 1 -- 172.21.15.3:0/3306435895 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e70009b30 con 0x7f4e780c1160 2023-03-06T14:16:03.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e76ffd700 1 --2- 172.21.15.3:0/3306435895 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e780c1160 0x7f4e7814a610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000e810 tx=0x7f4e6000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:03.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e6ffff700 1 -- 172.21.15.3:0/3306435895 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6000c070 con 0x7f4e780c1160 2023-03-06T14:16:03.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e6ffff700 1 -- 172.21.15.3:0/3306435895 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e60013610 con 0x7f4e780c1160 2023-03-06T14:16:03.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e6ffff700 1 -- 172.21.15.3:0/3306435895 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e600139a0 con 0x7f4e780c1160 2023-03-06T14:16:03.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e7dd86700 1 -- 172.21.15.3:0/3306435895 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e7814fe40 con 0x7f4e780c1160 2023-03-06T14:16:03.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.929+0000 7f4e7dd86700 1 -- 172.21.15.3:0/3306435895 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e7814fb60 con 0x7f4e780c1160 2023-03-06T14:16:03.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.931+0000 7f4e7dd86700 1 -- 172.21.15.3:0/3306435895 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e780bfde0 con 0x7f4e780c1160 2023-03-06T14:16:03.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.931+0000 7f4e6ffff700 1 -- 172.21.15.3:0/3306435895 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4e60013b00 con 0x7f4e780c1160 2023-03-06T14:16:03.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.931+0000 7f4e6ffff700 1 --2- 172.21.15.3:0/3306435895 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f4e580682f0 0x7f4e5806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:03.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.931+0000 7f4e6ffff700 1 -- 172.21.15.3:0/3306435895 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4e60085bc0 con 0x7f4e780c1160 2023-03-06T14:16:03.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.931+0000 7f4e777fe700 1 --2- 172.21.15.3:0/3306435895 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f4e580682f0 0x7f4e5806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:03.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.932+0000 7f4e777fe700 1 --2- 172.21.15.3:0/3306435895 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f4e580682f0 0x7f4e5806a7a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4e68007fd0 tx=0x7f4e68009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:03.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:03.935+0000 7f4e6ffff700 1 -- 172.21.15.3:0/3306435895 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4e60052130 con 0x7f4e780c1160 2023-03-06T14:16:04.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.133+0000 7f4e7dd86700 1 -- 172.21.15.3:0/3306435895 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e781da7d0 con 0x7f4e780c1160 2023-03-06T14:16:04.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.134+0000 7f4e6ffff700 1 -- 172.21.15.3:0/3306435895 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19604 (secure 0 0 0) 0x7f4e60055750 con 0x7f4e780c1160 2023-03-06T14:16:04.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:04.136 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":27,"fsid":"9aae2361-5af0-49eb-8f99-e7f69834fedf","created":"2023-03-06T14:15:33.357348+0000","modified":"2023-03-06T14:16:03.040402+0000","last_up_change":"2023-03-06T14:15:44.374764+0000","last_in_change":"2023-03-06T14:15:35.866803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T14:15:45.023761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T14:15:51.830917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-06T14:15:56.256188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-06T14:15:57.571429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-06T14:16:00.645210+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c92c9e49-8a23-48a5-87e5-51f184f73a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":96679},{"type":"v1","addr":"172.21.15.3:6809","nonce":96679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":96679},{"type":"v1","addr":"172.21.15.3:6811","nonce":96679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":96679},{"type":"v1","addr":"172.21.15.3:6818","nonce":96679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":96679},{"type":"v1","addr":"172.21.15.3:6814","nonce":96679}]},"public_addr":"172.21.15.3:6809/96679","cluster_addr":"172.21.15.3:6811/96679","heartbeat_back_addr":"172.21.15.3:6818/96679","heartbeat_front_addr":"172.21.15.3:6814/96679","state":["exists","up"]},{"osd":1,"uuid":"86ec9127-843f-4246-bfbe-e14ce3af7d17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":96681},{"type":"v1","addr":"172.21.15.3:6825","nonce":96681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":96681},{"type":"v1","addr":"172.21.15.3:6827","nonce":96681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":96681},{"type":"v1","addr":"172.21.15.3:6831","nonce":96681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":96681},{"type":"v1","addr":"172.21.15.3:6829","nonce":96681}]},"public_addr":"172.21.15.3:6825/96681","cluster_addr":"172.21.15.3:6827/96681","heartbeat_back_addr":"172.21.15.3:6831/96681","heartbeat_front_addr":"172.21.15.3:6829/96681","state":["exists","up"]},{"osd":2,"uuid":"67582de3-0f75-4cf0-84ca-e878986f99f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":96682},{"type":"v1","addr":"172.21.15.3:6815","nonce":96682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6817","nonce":96682},{"type":"v1","addr":"172.21.15.3:6819","nonce":96682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":96682},{"type":"v1","addr":"172.21.15.3:6823","nonce":96682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":96682},{"type":"v1","addr":"172.21.15.3:6821","nonce":96682}]},"public_addr":"172.21.15.3:6815/96682","cluster_addr":"172.21.15.3:6819/96682","heartbeat_back_addr":"172.21.15.3:6823/96682","heartbeat_front_addr":"172.21.15.3:6821/96682","state":["exists","up"]},{"osd":3,"uuid":"0fb8d708-4b38-4153-8a60-79741765d439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":96680},{"type":"v1","addr":"172.21.15.3:6801","nonce":96680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":96680},{"type":"v1","addr":"172.21.15.3:6803","nonce":96680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":96680},{"type":"v1","addr":"172.21.15.3:6807","nonce":96680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":96680},{"type":"v1","addr":"172.21.15.3:6805","nonce":96680}]},"public_addr":"172.21.15.3:6801/96680","cluster_addr":"172.21.15.3:6803/96680","heartbeat_back_addr":"172.21.15.3:6807/96680","heartbeat_front_addr":"172.21.15.3:6805/96680","state":["exists","up"]},{"osd":4,"uuid":"44eb9d99-975f-43a3-8bf4-213b2ba6dea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":96798},{"type":"v1","addr":"172.21.15.136:6822","nonce":96798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":96798},{"type":"v1","addr":"172.21.15.136:6826","nonce":96798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":96798},{"type":"v1","addr":"172.21.15.136:6831","nonce":96798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":96798},{"type":"v1","addr":"172.21.15.136:6829","nonce":96798}]},"public_addr":"172.21.15.136:6822/96798","cluster_addr":"172.21.15.136:6826/96798","heartbeat_back_addr":"172.21.15.136:6831/96798","heartbeat_front_addr":"172.21.15.136:6829/96798","state":["exists","up"]},{"osd":5,"uuid":"aff1a438-c444-4ebc-9806-d2d117878a2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":96796},{"type":"v1","addr":"172.21.15.136:6804","nonce":96796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":96796},{"type":"v1","addr":"172.21.15.136:6809","nonce":96796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":96796},{"type":"v1","addr":"172.21.15.136:6815","nonce":96796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":96796},{"type":"v1","addr":"172.21.15.136:6813","nonce":96796}]},"public_addr":"172.21.15.136:6804/96796","cluster_addr":"172.21.15.136:6809/96796","heartbeat_back_addr":"172.21.15.136:6815/96796","heartbeat_front_addr":"172.21.15.136:6813/96796","state":["exists","up"]},{"osd":6,"uuid":"89cc219c-f57b-43f4-8e54-76017dd4930d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":96797},{"type":"v1","addr":"172.21.15.136:6801","nonce":96797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6803","nonce":96797},{"type":"v1","addr":"172.21.15.136:6805","nonce":96797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":96797},{"type":"v1","addr":"172.21.15.136:6811","nonce":96797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":96797},{"type":"v1","addr":"172.21.15.136:6808","nonce":96797}]},"public_addr":"172.21.15.136:6801/96797","cluster_addr":"172.21.15.136:6805/96797","heartbeat_back_addr":"172.21.15.136:6811/96797","heartbeat_front_addr":"172.21.15.136:6808/96797","state":["exists","up"]},{"osd":7,"uuid":"a90e4c14-00de-4d1c-92ce-9f20df714e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":96819},{"type":"v1","addr":"172.21.15.136:6817","nonce":96819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":96819},{"type":"v1","addr":"172.21.15.136:6819","nonce":96819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":96819},{"type":"v1","addr":"172.21.15.136:6827","nonce":96819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":96819},{"type":"v1","addr":"172.21.15.136:6823","nonce":96819}]},"public_addr":"172.21.15.136:6817/96819","cluster_addr":"172.21.15.136:6819/96819","heartbeat_back_addr":"172.21.15.136:6827/96819","heartbeat_front_addr":"172.21.15.136:6823/96819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.093141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.034488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.128137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.097924+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.045441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.005820+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.039918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.082053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T14:16:04.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.136+0000 7f4e7dd86700 1 -- 172.21.15.3:0/3306435895 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f4e580682f0 msgr2=0x7f4e5806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:04.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.136+0000 7f4e7dd86700 1 --2- 172.21.15.3:0/3306435895 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f4e580682f0 0x7f4e5806a7a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4e68007fd0 tx=0x7f4e68009040 comp rx=0 tx=0).stop 2023-03-06T14:16:04.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.136+0000 7f4e7dd86700 1 -- 172.21.15.3:0/3306435895 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e780c1160 msgr2=0x7f4e7814a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:04.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.136+0000 7f4e7dd86700 1 --2- 172.21.15.3:0/3306435895 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e780c1160 0x7f4e7814a610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000e810 tx=0x7f4e6000eb20 comp rx=0 tx=0).stop 2023-03-06T14:16:04.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.136+0000 7f4e7dd86700 1 -- 172.21.15.3:0/3306435895 shutdown_connections 2023-03-06T14:16:04.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.136+0000 7f4e7dd86700 1 --2- 172.21.15.3:0/3306435895 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f4e580682f0 0x7f4e5806a7a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:04.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.136+0000 7f4e7dd86700 1 --2- 172.21.15.3:0/3306435895 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e781491d0 0x7f4e781daaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:04.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.136+0000 7f4e7dd86700 1 --2- 172.21.15.3:0/3306435895 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e780bf4f0 0x7f4e780b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:04.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.136+0000 7f4e7dd86700 1 --2- 172.21.15.3:0/3306435895 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e780c1160 0x7f4e7814a610 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:04.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.136+0000 7f4e7dd86700 1 -- 172.21.15.3:0/3306435895 >> 172.21.15.3:0/3306435895 conn(0x7f4e7806a2d0 msgr2=0x7f4e780c04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:04.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.136+0000 7f4e7dd86700 1 -- 172.21.15.3:0/3306435895 shutdown_connections 2023-03-06T14:16:04.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.136+0000 7f4e7dd86700 1 -- 172.21.15.3:0/3306435895 wait complete. 2023-03-06T14:16:04.165 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-06T14:16:04.167 INFO:tasks.ceph.mds.c.smithi003.stderr:2023-03-06T14:16:04.166+0000 7fe57bafd700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-06T14:16:04.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.288+0000 7f68b11c6700 1 Processor -- start 2023-03-06T14:16:04.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.288+0000 7f68b11c6700 1 -- start start 2023-03-06T14:16:04.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.288+0000 7f68b11c6700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f68ac06ee40 0x7f68ac0bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:04.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.288+0000 7f68b11c6700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68ac14ff80 con 0x7f68ac0bdd60 2023-03-06T14:16:04.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.288+0000 7f68b11c6700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68ac0bcb90 con 0x7f68ac06ea70 2023-03-06T14:16:04.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.288+0000 7f68b11c6700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68ac0b9070 con 0x7f68ac06ee40 2023-03-06T14:16:04.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68ab59e700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f68ac0bdd60 0x7f68ac06c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57894/0 (socket says 172.21.15.3:57894) 2023-03-06T14:16:04.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68ab59e700 1 -- 172.21.15.3:0/798490740 learned_addr learned my addr 172.21.15.3:0/798490740 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:04.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68aa59c700 1 --2- 172.21.15.3:0/798490740 >> v2:172.21.15.136:3300/0 conn(0x7f68ac06ee40 0x7f68ac0bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:04.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68a9d9b700 1 -- 172.21.15.3:0/798490740 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857553165 0 0) 0x7f68ac14ff80 con 0x7f68ac0bdd60 2023-03-06T14:16:04.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68a9d9b700 1 -- 172.21.15.3:0/798490740 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68940035b0 con 0x7f68ac0bdd60 2023-03-06T14:16:04.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68a9d9b700 1 -- 172.21.15.3:0/798490740 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3667216286 0 0) 0x7f68940035b0 con 0x7f68ac0bdd60 2023-03-06T14:16:04.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68a9d9b700 1 -- 172.21.15.3:0/798490740 >> v2:172.21.15.136:3300/0 conn(0x7f68ac06ee40 msgr2=0x7f68ac0bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:04.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68a9d9b700 1 --2- 172.21.15.3:0/798490740 >> v2:172.21.15.136:3300/0 conn(0x7f68ac06ee40 0x7f68ac0bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:04.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68a9d9b700 1 -- 172.21.15.3:0/798490740 >> v1:172.21.15.136:6789/0 conn(0x7f68ac06ea70 legacy=0x7f68ac1490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:04.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68a9d9b700 1 -- 172.21.15.3:0/798490740 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac0bce70 con 0x7f68ac0bdd60 2023-03-06T14:16:04.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68a9d9b700 1 -- 172.21.15.3:0/798490740 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3255535284 0 0) 0x7f68a40019f0 con 0x7f68ac0bdd60 2023-03-06T14:16:04.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68a9d9b700 1 -- 172.21.15.3:0/798490740 >> v1:172.21.15.3:6789/0 conn(0x7f68ac0bdd60 legacy=0x7f68ac06c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:04.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68a9d9b700 1 --2- 172.21.15.3:0/798490740 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6894003a00 0x7f6894003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:04.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68a9d9b700 1 --2- 172.21.15.3:0/798490740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68940043f0 0x7f68940048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:04.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68a9d9b700 1 --2- 172.21.15.3:0/798490740 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f68940050b0 0x7f689400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:04.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68a9d9b700 1 -- 172.21.15.3:0/798490740 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689400c000 con 0x7f6894003a00 2023-03-06T14:16:04.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68a9d9b700 1 -- 172.21.15.3:0/798490740 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689400c140 con 0x7f68940043f0 2023-03-06T14:16:04.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68a9d9b700 1 -- 172.21.15.3:0/798490740 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689400c300 con 0x7f68940050b0 2023-03-06T14:16:04.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68aad9d700 1 --2- 172.21.15.3:0/798490740 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6894003a00 0x7f6894003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:04.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68aa59c700 1 --2- 172.21.15.3:0/798490740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68940043f0 0x7f68940048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:04.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68ab59e700 1 --2- 172.21.15.3:0/798490740 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f68940050b0 0x7f689400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:04.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.289+0000 7f68aad9d700 1 -- 172.21.15.3:0/798490740 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f68940050b0 msgr2=0x7f689400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:04.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.290+0000 7f68aad9d700 1 --2- 172.21.15.3:0/798490740 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f68940050b0 0x7f689400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:04.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.290+0000 7f68aad9d700 1 -- 172.21.15.3:0/798490740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68940043f0 msgr2=0x7f68940048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:04.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.290+0000 7f68aad9d700 1 --2- 172.21.15.3:0/798490740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68940043f0 0x7f68940048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:04.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.290+0000 7f68aad9d700 1 -- 172.21.15.3:0/798490740 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68940035b0 con 0x7f6894003a00 2023-03-06T14:16:04.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.290+0000 7f68ab59e700 1 -- 172.21.15.3:0/798490740 reap_dead start 2023-03-06T14:16:04.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.290+0000 7f68aad9d700 1 --2- 172.21.15.3:0/798490740 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6894003a00 0x7f6894003dd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f689c001930 tx=0x7f6894005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a067f8f7927fc63 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:04.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.290+0000 7f68a9d9b700 1 -- 172.21.15.3:0/798490740 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c0013a0 con 0x7f6894003a00 2023-03-06T14:16:04.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.290+0000 7f68a9d9b700 1 -- 172.21.15.3:0/798490740 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689c0052f0 con 0x7f6894003a00 2023-03-06T14:16:04.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.290+0000 7f68a9d9b700 1 -- 172.21.15.3:0/798490740 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c0036d0 con 0x7f6894003a00 2023-03-06T14:16:04.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.290+0000 7f68b11c6700 1 -- 172.21.15.3:0/798490740 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6894003a00 msgr2=0x7f6894003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:04.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.290+0000 7f68b11c6700 1 --2- 172.21.15.3:0/798490740 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6894003a00 0x7f6894003dd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f689c001930 tx=0x7f6894005880 comp rx=0 tx=0).stop 2023-03-06T14:16:04.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.290+0000 7f68b11c6700 1 -- 172.21.15.3:0/798490740 shutdown_connections 2023-03-06T14:16:04.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.290+0000 7f68b11c6700 1 --2- 172.21.15.3:0/798490740 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6894003a00 0x7f6894003dd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:04.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.290+0000 7f68b11c6700 1 -- 172.21.15.3:0/798490740 >> 172.21.15.3:0/798490740 conn(0x7f68ac0c2150 msgr2=0x7f68ac0c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:04.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.290+0000 7f68b11c6700 1 -- 172.21.15.3:0/798490740 shutdown_connections 2023-03-06T14:16:04.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.290+0000 7f68b11c6700 1 -- 172.21.15.3:0/798490740 wait complete. 2023-03-06T14:16:04.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.292+0000 7f68b11c6700 1 Processor -- start 2023-03-06T14:16:04.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.292+0000 7f68b11c6700 1 -- start start 2023-03-06T14:16:04.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.292+0000 7f68b11c6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6894003a00 0x7f68ac0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:04.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68b11c6700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f68ac0a7f00 0x7f68ac1e44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:04.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68b11c6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68ac1e83d0 0x7f68ac1e49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:04.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68b11c6700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac1e4f20 con 0x7f6894003a00 2023-03-06T14:16:04.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68b11c6700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac1e8950 con 0x7f68ac1e83d0 2023-03-06T14:16:04.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68b11c6700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac151d00 con 0x7f68ac0a7f00 2023-03-06T14:16:04.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68aad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6894003a00 0x7f68ac0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:04.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68aad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6894003a00 0x7f68ac0c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55630/0 (socket says 172.21.15.3:55630) 2023-03-06T14:16:04.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68aad9d700 1 -- 172.21.15.3:0/2768054886 learned_addr learned my addr 172.21.15.3:0/2768054886 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:04.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68ab59e700 1 --2- 172.21.15.3:0/2768054886 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68ac1e83d0 0x7f68ac1e49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:04.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68aa59c700 1 --2- 172.21.15.3:0/2768054886 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f68ac0a7f00 0x7f68ac1e44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:04.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68aad9d700 1 -- 172.21.15.3:0/2768054886 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f68ac0a7f00 msgr2=0x7f68ac1e44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:04.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68aad9d700 1 --2- 172.21.15.3:0/2768054886 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f68ac0a7f00 0x7f68ac1e44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:04.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68aad9d700 1 -- 172.21.15.3:0/2768054886 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68ac1e83d0 msgr2=0x7f68ac1e49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:04.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68aad9d700 1 --2- 172.21.15.3:0/2768054886 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68ac1e83d0 0x7f68ac1e49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:04.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68aad9d700 1 -- 172.21.15.3:0/2768054886 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac150220 con 0x7f6894003a00 2023-03-06T14:16:04.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68aad9d700 1 --2- 172.21.15.3:0/2768054886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6894003a00 0x7f68ac0c19e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f689c006f70 tx=0x7f689c001280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:04.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68937fe700 1 -- 172.21.15.3:0/2768054886 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c007710 con 0x7f6894003a00 2023-03-06T14:16:04.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68937fe700 1 -- 172.21.15.3:0/2768054886 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689c001320 con 0x7f6894003a00 2023-03-06T14:16:04.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68b11c6700 1 -- 172.21.15.3:0/2768054886 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ac0bd150 con 0x7f6894003a00 2023-03-06T14:16:04.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68937fe700 1 -- 172.21.15.3:0/2768054886 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c0038d0 con 0x7f6894003a00 2023-03-06T14:16:04.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.293+0000 7f68b11c6700 1 -- 172.21.15.3:0/2768054886 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ac0b8b80 con 0x7f6894003a00 2023-03-06T14:16:04.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.294+0000 7f68b11c6700 1 -- 172.21.15.3:0/2768054886 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ac0bdb80 con 0x7f6894003a00 2023-03-06T14:16:04.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.295+0000 7f68937fe700 1 -- 172.21.15.3:0/2768054886 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f689c026030 con 0x7f6894003a00 2023-03-06T14:16:04.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.295+0000 7f68937fe700 1 --2- 172.21.15.3:0/2768054886 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f68980682f0 0x7f689806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:04.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.295+0000 7f68937fe700 1 -- 172.21.15.3:0/2768054886 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f689c086610 con 0x7f6894003a00 2023-03-06T14:16:04.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.295+0000 7f68aa59c700 1 --2- 172.21.15.3:0/2768054886 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f68980682f0 0x7f689806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:04.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.296+0000 7f68aa59c700 1 --2- 172.21.15.3:0/2768054886 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f68980682f0 0x7f689806a7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f68ac153740 tx=0x7f68a0009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:04.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.299+0000 7f68937fe700 1 -- 172.21.15.3:0/2768054886 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f689c052cf0 con 0x7f6894003a00 2023-03-06T14:16:04.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.536+0000 7f68b11c6700 1 -- 172.21.15.3:0/2768054886 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68ac06d540 con 0x7f6894003a00 2023-03-06T14:16:04.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.537+0000 7f68937fe700 1 -- 172.21.15.3:0/2768054886 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4644 (secure 0 0 0) 0x7f689c056310 con 0x7f6894003a00 2023-03-06T14:16:04.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:04.539 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/3666647721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3666647721},{"type":"v1","addr":"172.21.15.136:6835","nonce":3666647721}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6834/1347040159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":1347040159},{"type":"v1","addr":"172.21.15.3:6834","nonce":1347040159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2387644382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2387644382},{"type":"v1","addr":"172.21.15.136:6837","nonce":2387644382}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-06T14:15:58.597248+0000","modified":"2023-03-06T14:16:03.040620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6835/3655666630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6833","nonce":3655666630},{"type":"v1","addr":"172.21.15.3:6835","nonce":3655666630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-03-06T14:16:04.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.539+0000 7f68b11c6700 1 -- 172.21.15.3:0/2768054886 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f68980682f0 msgr2=0x7f689806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:04.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.539+0000 7f68b11c6700 1 --2- 172.21.15.3:0/2768054886 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f68980682f0 0x7f689806a7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f68ac153740 tx=0x7f68a0009210 comp rx=0 tx=0).stop 2023-03-06T14:16:04.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.539+0000 7f68b11c6700 1 -- 172.21.15.3:0/2768054886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6894003a00 msgr2=0x7f68ac0c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:04.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.539+0000 7f68b11c6700 1 --2- 172.21.15.3:0/2768054886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6894003a00 0x7f68ac0c19e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f689c006f70 tx=0x7f689c001280 comp rx=0 tx=0).stop 2023-03-06T14:16:04.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.539+0000 7f68b11c6700 1 -- 172.21.15.3:0/2768054886 shutdown_connections 2023-03-06T14:16:04.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.539+0000 7f68b11c6700 1 --2- 172.21.15.3:0/2768054886 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f68980682f0 0x7f689806a7a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:04.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.539+0000 7f68b11c6700 1 --2- 172.21.15.3:0/2768054886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6894003a00 0x7f68ac0c19e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:04.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.539+0000 7f68b11c6700 1 --2- 172.21.15.3:0/2768054886 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68ac1e83d0 0x7f68ac1e49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:04.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.539+0000 7f68b11c6700 1 --2- 172.21.15.3:0/2768054886 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f68ac0a7f00 0x7f68ac1e44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:04.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.539+0000 7f68b11c6700 1 -- 172.21.15.3:0/2768054886 >> 172.21.15.3:0/2768054886 conn(0x7f68ac0c2150 msgr2=0x7f68ac06ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:04.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.539+0000 7f68b11c6700 1 -- 172.21.15.3:0/2768054886 shutdown_connections 2023-03-06T14:16:04.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:04.539+0000 7f68b11c6700 1 -- 172.21.15.3:0/2768054886 wait complete. 2023-03-06T14:16:04.543 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 7 2023-03-06T14:16:04.955 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-03-06T14:15:58.597248+0000', 'modified': '2023-03-06T14:16:03.040620+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.3:6835/3655666630', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.3:6833', 'nonce': 3655666630}, {'type': 'v1', 'addr': '172.21.15.3:6835', 'nonce': 3655666630}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-03-06T14:16:04.955 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-03-06T14:16:04.956 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-03-06T14:16:05.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.085+0000 7ffb50d11700 1 Processor -- start 2023-03-06T14:16:05.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.085+0000 7ffb50d11700 1 -- start start 2023-03-06T14:16:05.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb50d11700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ffb4c06ea70 0x7ffb4c0bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb50d11700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb4c06ee40 0x7ffb4c1490f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb50d11700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb4c14ff80 con 0x7ffb4c0bdd60 2023-03-06T14:16:05.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb50d11700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4c0b9070 con 0x7ffb4c06ea70 2023-03-06T14:16:05.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb50d11700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c0bcb90 con 0x7ffb4c06ee40 2023-03-06T14:16:05.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4ad9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7ffb4c0bdd60 0x7ffb4c06c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57914/0 (socket says 172.21.15.3:57914) 2023-03-06T14:16:05.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4ad9d700 1 -- 172.21.15.3:0/3878968811 learned_addr learned my addr 172.21.15.3:0/3878968811 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:05.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4a59c700 1 --2- 172.21.15.3:0/3878968811 >> v2:172.21.15.136:3300/0 conn(0x7ffb4c06ea70 0x7ffb4c0bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb49d9b700 1 --2- 172.21.15.3:0/3878968811 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb4c06ee40 0x7ffb4c1490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4959a700 1 -- 172.21.15.3:0/3878968811 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380002395 0 0) 0x7ffb4c14ff80 con 0x7ffb4c0bdd60 2023-03-06T14:16:05.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4959a700 1 -- 172.21.15.3:0/3878968811 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb340035b0 con 0x7ffb4c0bdd60 2023-03-06T14:16:05.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4959a700 1 -- 172.21.15.3:0/3878968811 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2778526768 0 0) 0x7ffb340035b0 con 0x7ffb4c0bdd60 2023-03-06T14:16:05.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4959a700 1 -- 172.21.15.3:0/3878968811 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb4c06ee40 msgr2=0x7ffb4c1490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:05.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4959a700 1 --2- 172.21.15.3:0/3878968811 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb4c06ee40 0x7ffb4c1490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4959a700 1 -- 172.21.15.3:0/3878968811 >> v2:172.21.15.136:3300/0 conn(0x7ffb4c06ea70 msgr2=0x7ffb4c0bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:05.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4959a700 1 --2- 172.21.15.3:0/3878968811 >> v2:172.21.15.136:3300/0 conn(0x7ffb4c06ea70 0x7ffb4c0bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4959a700 1 -- 172.21.15.3:0/3878968811 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4c0bce70 con 0x7ffb4c0bdd60 2023-03-06T14:16:05.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4959a700 1 -- 172.21.15.3:0/3878968811 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3255535284 0 0) 0x7ffb440019f0 con 0x7ffb4c0bdd60 2023-03-06T14:16:05.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4a59c700 1 --2- 172.21.15.3:0/3878968811 >> v2:172.21.15.136:3300/0 conn(0x7ffb4c06ea70 0x7ffb4c0bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:16:05.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4959a700 1 -- 172.21.15.3:0/3878968811 >> v1:172.21.15.3:6789/0 conn(0x7ffb4c0bdd60 legacy=0x7ffb4c06c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:05.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4959a700 1 --2- 172.21.15.3:0/3878968811 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb4c06ee40 0x7ffb34003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4959a700 1 --2- 172.21.15.3:0/3878968811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb34003f80 0x7ffb34004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4959a700 1 --2- 172.21.15.3:0/3878968811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb34004d90 0x7ffb34005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4959a700 1 -- 172.21.15.3:0/3878968811 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c0bcb90 con 0x7ffb34003f80 2023-03-06T14:16:05.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4959a700 1 -- 172.21.15.3:0/3878968811 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3400ba10 con 0x7ffb34004d90 2023-03-06T14:16:05.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb4959a700 1 -- 172.21.15.3:0/3878968811 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3400bb50 con 0x7ffb4c06ee40 2023-03-06T14:16:05.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.086+0000 7ffb49d9b700 1 --2- 172.21.15.3:0/3878968811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb34003f80 0x7ffb34004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.087+0000 7ffb4a59c700 1 --2- 172.21.15.3:0/3878968811 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb4c06ee40 0x7ffb34003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.087+0000 7ffb4ad9d700 1 --2- 172.21.15.3:0/3878968811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb34004d90 0x7ffb34005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.087+0000 7ffb49d9b700 1 -- 172.21.15.3:0/3878968811 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb4c06ee40 msgr2=0x7ffb34003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:05.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.087+0000 7ffb49d9b700 1 --2- 172.21.15.3:0/3878968811 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb4c06ee40 0x7ffb34003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.087+0000 7ffb49d9b700 1 -- 172.21.15.3:0/3878968811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb34004d90 msgr2=0x7ffb34005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:05.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.087+0000 7ffb49d9b700 1 --2- 172.21.15.3:0/3878968811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb34004d90 0x7ffb34005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.087+0000 7ffb49d9b700 1 -- 172.21.15.3:0/3878968811 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb340035b0 con 0x7ffb34003f80 2023-03-06T14:16:05.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.087+0000 7ffb49d9b700 1 --2- 172.21.15.3:0/3878968811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb34003f80 0x7ffb34004850 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffb40009b60 tx=0x7ffb34005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79814bfdc944b64d server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:05.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.087+0000 7ffb4959a700 1 -- 172.21.15.3:0/3878968811 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4000e6c0 con 0x7ffb34003f80 2023-03-06T14:16:05.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.087+0000 7ffb4959a700 1 -- 172.21.15.3:0/3878968811 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4000e820 con 0x7ffb34003f80 2023-03-06T14:16:05.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.087+0000 7ffb4959a700 1 -- 172.21.15.3:0/3878968811 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4000eb90 con 0x7ffb34003f80 2023-03-06T14:16:05.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.087+0000 7ffb50d11700 1 -- 172.21.15.3:0/3878968811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb34003f80 msgr2=0x7ffb34004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:05.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.087+0000 7ffb50d11700 1 --2- 172.21.15.3:0/3878968811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb34003f80 0x7ffb34004850 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffb40009b60 tx=0x7ffb34005880 comp rx=0 tx=0).stop 2023-03-06T14:16:05.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.087+0000 7ffb4ad9d700 1 -- 172.21.15.3:0/3878968811 reap_dead start 2023-03-06T14:16:05.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.088+0000 7ffb50d11700 1 -- 172.21.15.3:0/3878968811 shutdown_connections 2023-03-06T14:16:05.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.088+0000 7ffb50d11700 1 -- 172.21.15.3:0/3878968811 >> 172.21.15.3:0/3878968811 conn(0x7ffb4c0c2150 msgr2=0x7ffb4c0c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:05.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.088+0000 7ffb50d11700 1 -- 172.21.15.3:0/3878968811 shutdown_connections 2023-03-06T14:16:05.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.088+0000 7ffb50d11700 1 -- 172.21.15.3:0/3878968811 wait complete. 2023-03-06T14:16:05.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.089+0000 7ffb50d11700 1 Processor -- start 2023-03-06T14:16:05.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.089+0000 7ffb50d11700 1 -- start start 2023-03-06T14:16:05.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb50d11700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb34003f80 0x7ffb4c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb50d11700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb4c1504c0 0x7ffb4c151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb50d11700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb4c1e77c0 0x7ffb4c0bb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb50d11700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c1e75d0 con 0x7ffb4c1504c0 2023-03-06T14:16:05.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb50d11700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c153460 con 0x7ffb4c1e77c0 2023-03-06T14:16:05.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb50d11700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c1509c0 con 0x7ffb34003f80 2023-03-06T14:16:05.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb49d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb4c1504c0 0x7ffb4c151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb49d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb4c1504c0 0x7ffb4c151a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55652/0 (socket says 172.21.15.3:55652) 2023-03-06T14:16:05.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb49d9b700 1 -- 172.21.15.3:0/110015407 learned_addr learned my addr 172.21.15.3:0/110015407 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:05.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb4a59c700 1 --2- 172.21.15.3:0/110015407 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb34003f80 0x7ffb4c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb4ad9d700 1 --2- 172.21.15.3:0/110015407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb4c1e77c0 0x7ffb4c0bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb49d9b700 1 -- 172.21.15.3:0/110015407 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb34003f80 msgr2=0x7ffb4c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:05.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb49d9b700 1 --2- 172.21.15.3:0/110015407 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb34003f80 0x7ffb4c152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb49d9b700 1 -- 172.21.15.3:0/110015407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb4c1e77c0 msgr2=0x7ffb4c0bb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:05.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb49d9b700 1 --2- 172.21.15.3:0/110015407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb4c1e77c0 0x7ffb4c0bb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb49d9b700 1 -- 172.21.15.3:0/110015407 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4c150220 con 0x7ffb4c1504c0 2023-03-06T14:16:05.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb49d9b700 1 --2- 172.21.15.3:0/110015407 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb4c1504c0 0x7ffb4c151a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffb400090b0 tx=0x7ffb400047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:05.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb3affd700 1 -- 172.21.15.3:0/110015407 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4000e6c0 con 0x7ffb4c1504c0 2023-03-06T14:16:05.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb3affd700 1 -- 172.21.15.3:0/110015407 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb400038c0 con 0x7ffb4c1504c0 2023-03-06T14:16:05.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb50d11700 1 -- 172.21.15.3:0/110015407 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4c0bd150 con 0x7ffb4c1504c0 2023-03-06T14:16:05.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb3affd700 1 -- 172.21.15.3:0/110015407 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40003c70 con 0x7ffb4c1504c0 2023-03-06T14:16:05.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.090+0000 7ffb50d11700 1 -- 172.21.15.3:0/110015407 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4c0b8b80 con 0x7ffb4c1504c0 2023-03-06T14:16:05.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.092+0000 7ffb3affd700 1 -- 172.21.15.3:0/110015407 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ffb40019030 con 0x7ffb4c1504c0 2023-03-06T14:16:05.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.092+0000 7ffb3affd700 1 --2- 172.21.15.3:0/110015407 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7ffb2c0682f0 0x7ffb2c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.092+0000 7ffb3affd700 1 -- 172.21.15.3:0/110015407 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffb40087460 con 0x7ffb4c1504c0 2023-03-06T14:16:05.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.092+0000 7ffb4a59c700 1 --2- 172.21.15.3:0/110015407 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7ffb2c0682f0 0x7ffb2c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.093+0000 7ffb4a59c700 1 --2- 172.21.15.3:0/110015407 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7ffb2c0682f0 0x7ffb2c06a7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c009e40 tx=0x7ffb3c0091c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:05.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.094+0000 7ffb5ce9ab80 1 Processor -- start 2023-03-06T14:16:05.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.094+0000 7ffb5ce9ab80 1 -- start start 2023-03-06T14:16:05.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.095+0000 7ffb5ce9ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab91ad0 0x55cc0ab91ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.095+0000 7ffb5ce9ab80 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55cc0ab97410 0x55cc0ab95030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.095+0000 7ffb5ce9ab80 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab95570 0x55cc0abb1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.095+0000 7ffb5ce9ab80 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0aa80bc0 con 0x55cc0ab95570 2023-03-06T14:16:05.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.095+0000 7ffb5ce9ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0aaef350 con 0x55cc0ab91ad0 2023-03-06T14:16:05.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.095+0000 7ffb5ce9ab80 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc0aae8880 con 0x55cc0ab97410 2023-03-06T14:16:05.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.095+0000 7ffb4ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab95570 0x55cc0abb1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.095+0000 7ffb4ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab95570 0x55cc0abb1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55662/0 (socket says 172.21.15.3:55662) 2023-03-06T14:16:05.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.095+0000 7ffb4ad9d700 1 -- 172.21.15.3:0/1166822779 learned_addr learned my addr 172.21.15.3:0/1166822779 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:05.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.095+0000 7ffb49d9b700 1 --2- 172.21.15.3:0/1166822779 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55cc0ab97410 0x55cc0ab95030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.095+0000 7ffb4a59c700 1 --2- 172.21.15.3:0/1166822779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab91ad0 0x55cc0ab91ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.095+0000 7ffb4ad9d700 1 -- 172.21.15.3:0/1166822779 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55cc0ab97410 msgr2=0x55cc0ab95030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:05.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.095+0000 7ffb4ad9d700 1 --2- 172.21.15.3:0/1166822779 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55cc0ab97410 0x55cc0ab95030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.095+0000 7ffb4ad9d700 1 -- 172.21.15.3:0/1166822779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab91ad0 msgr2=0x55cc0ab91ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:05.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.095+0000 7ffb4ad9d700 1 --2- 172.21.15.3:0/1166822779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab91ad0 0x55cc0ab91ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.095+0000 7ffb4ad9d700 1 -- 172.21.15.3:0/1166822779 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc0a96a5e0 con 0x55cc0ab95570 2023-03-06T14:16:05.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.095+0000 7ffb4ad9d700 1 --2- 172.21.15.3:0/1166822779 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab95570 0x55cc0abb1900 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0be160 tx=0x7ffb4400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe1581e273b8715 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:05.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.096+0000 7ffb2bfff700 1 -- 172.21.15.3:0/1166822779 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb440079c0 con 0x55cc0ab95570 2023-03-06T14:16:05.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.096+0000 7ffb2bfff700 1 -- 172.21.15.3:0/1166822779 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb44007b20 con 0x55cc0ab95570 2023-03-06T14:16:05.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.096+0000 7ffb2bfff700 1 -- 172.21.15.3:0/1166822779 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb44015640 con 0x55cc0ab95570 2023-03-06T14:16:05.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.096+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/1166822779 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab95570 msgr2=0x55cc0abb1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:05.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.096+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/1166822779 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab95570 0x55cc0abb1900 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0be160 tx=0x7ffb4400a060 comp rx=0 tx=0).stop 2023-03-06T14:16:05.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.096+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/1166822779 shutdown_connections 2023-03-06T14:16:05.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.096+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/1166822779 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab95570 0x55cc0abb1900 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.096+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/1166822779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab91ad0 0x55cc0ab91ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.096+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/1166822779 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55cc0ab97410 0x55cc0ab95030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.096+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/1166822779 >> 172.21.15.3:0/1166822779 conn(0x55cc0ab8b720 msgr2=0x55cc0ab945b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:05.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.096+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/1166822779 shutdown_connections 2023-03-06T14:16:05.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.096+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/1166822779 wait complete. 2023-03-06T14:16:05.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.097+0000 7ffb5ce9ab80 1 -- start start 2023-03-06T14:16:05.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.097+0000 7ffb5ce9ab80 1 Processor -- start 2023-03-06T14:16:05.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.098+0000 7ffb5ce9ab80 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55cc0ab91ad0 0x55cc0abc92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.098+0000 7ffb5ce9ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab95570 0x55cc0abe1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.098+0000 7ffb5ce9ab80 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab97410 0x55cc0abcc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.098+0000 7ffb5ce9ab80 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0a96c8d0 con 0x55cc0ab97410 2023-03-06T14:16:05.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.098+0000 7ffb5ce9ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0abe1ae0 con 0x55cc0ab95570 2023-03-06T14:16:05.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.098+0000 7ffb5ce9ab80 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc0abaf590 con 0x55cc0ab91ad0 2023-03-06T14:16:05.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.098+0000 7ffb5ce9ab80 10 client.0 _ll_register_callbacks cb 0x55cc0aa86630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-06T14:16:05.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.098+0000 7ffb4ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab97410 0x55cc0abcc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.098+0000 7ffb4ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab97410 0x55cc0abcc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55668/0 (socket says 172.21.15.3:55668) 2023-03-06T14:16:05.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.098+0000 7ffb4ad9d700 1 -- 172.21.15.3:0/675911533 learned_addr learned my addr 172.21.15.3:0/675911533 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:05.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.098+0000 7ffb4a59c700 1 --2- 172.21.15.3:0/675911533 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55cc0ab91ad0 0x55cc0abc92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.098+0000 7ffb49d9b700 1 --2- 172.21.15.3:0/675911533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab95570 0x55cc0abe1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.098+0000 7ffb4ad9d700 1 -- 172.21.15.3:0/675911533 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55cc0ab91ad0 msgr2=0x55cc0abc92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:05.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.098+0000 7ffb4ad9d700 1 --2- 172.21.15.3:0/675911533 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55cc0ab91ad0 0x55cc0abc92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.098+0000 7ffb4ad9d700 1 -- 172.21.15.3:0/675911533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab95570 msgr2=0x55cc0abe1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:05.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.098+0000 7ffb4ad9d700 1 --2- 172.21.15.3:0/675911533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab95570 0x55cc0abe1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.098+0000 7ffb4ad9d700 1 -- 172.21.15.3:0/675911533 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb3c009430 con 0x55cc0ab97410 2023-03-06T14:16:05.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.098+0000 7ffb4ad9d700 1 --2- 172.21.15.3:0/675911533 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab97410 0x55cc0abcc540 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffb44018040 tx=0x7ffb44001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4d19e10289f97f server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:05.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.098+0000 7ffb297fa700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-03-06T14:16:05.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.099+0000 7ffb297fa700 1 -- 172.21.15.3:0/675911533 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb44020cd0 con 0x55cc0ab97410 2023-03-06T14:16:05.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.099+0000 7ffb297fa700 1 -- 172.21.15.3:0/675911533 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffb44020e30 con 0x55cc0ab97410 2023-03-06T14:16:05.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.099+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/675911533 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc0aab6140 con 0x55cc0ab97410 2023-03-06T14:16:05.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.099+0000 7ffb297fa700 1 -- 172.21.15.3:0/675911533 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb4401e450 con 0x55cc0ab97410 2023-03-06T14:16:05.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.099+0000 7ffb5ce9ab80 10 client.4425 fetch_fsmap learned FSMap version 7 2023-03-06T14:16:05.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.099+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/675911533 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55cc0a916d90 con 0x55cc0ab97410 2023-03-06T14:16:05.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.099+0000 7ffb297fa700 1 -- 172.21.15.3:0/675911533 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cc0aab6140 con 0x55cc0ab97410 2023-03-06T14:16:05.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.099+0000 7ffb297fa700 1 -- 172.21.15.3:0/675911533 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ffb44012050 con 0x55cc0ab97410 2023-03-06T14:16:05.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.099+0000 7ffb5ce9ab80 10 client.4425 fetch_fsmap finished waiting for FSMap version 7 2023-03-06T14:16:05.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.099+0000 7ffb5ce9ab80 10 client.4425 resolve_mds: resolved name 'c' to daemon mds.c 2023-03-06T14:16:05.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.099+0000 7ffb5ce9ab80 20 client.4425 populate_metadata read hostname 'smithi003' 2023-03-06T14:16:05.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.099+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/675911533 >> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] conn(0x55cc0abcd540 0x55cc0abcd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.099+0000 7ffb5ce9ab80 4 client.4425 mds_command: new command op to 4287 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-06T14:16:05.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.099+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/675911533 --> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cc0a96cf10 con 0x55cc0abcd540 2023-03-06T14:16:05.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.099+0000 7ffb4a59c700 1 --2- 172.21.15.3:0/675911533 >> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] conn(0x55cc0abcd540 0x55cc0abcd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.100+0000 7ffb297fa700 10 client.4425 ms_handle_connect on v2:172.21.15.3:6833/3655666630 2023-03-06T14:16:05.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.100+0000 7ffb4a59c700 1 --2- 172.21.15.3:0/675911533 >> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] conn(0x55cc0abcd540 0x55cc0abcd910 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e1eca663679b826 server_cookie=e8755e6fc1441b4f in_seq=0 out_seq=0 2023-03-06T14:16:05.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.100+0000 7ffb297fa700 1 -- 172.21.15.3:0/675911533 <== mds.0 v2:172.21.15.3:6833/3655666630 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55cc0a96cf10 con 0x55cc0abcd540 2023-03-06T14:16:05.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.100+0000 7ffb297fa700 10 client.4425 handle_command_reply: tid=0 2023-03-06T14:16:05.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.100+0000 7ffb5ce9ab80 1 client.4425 shutdown 2023-03-06T14:16:05.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.100+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/675911533 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab97410 msgr2=0x55cc0abcc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:05.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.100+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/675911533 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab97410 0x55cc0abcc540 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffb44018040 tx=0x7ffb44001360 comp rx=0 tx=0).stop 2023-03-06T14:16:05.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.100+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/675911533 shutdown_connections 2023-03-06T14:16:05.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.100+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/675911533 >> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] conn(0x55cc0abcd540 0x55cc0abcd910 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.100+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/675911533 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab97410 0x55cc0abcc540 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.100+0000 7ffb297fa700 0 client.4425 ms_handle_reset on v2:172.21.15.3:6833/3655666630 2023-03-06T14:16:05.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.100+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/675911533 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55cc0ab91ad0 0x55cc0abc92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.100+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/675911533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab95570 0x55cc0abe1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.100+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/675911533 >> 172.21.15.3:0/675911533 conn(0x55cc0ab8b720 msgr2=0x55cc0ab96770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:05.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.100+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/675911533 shutdown_connections 2023-03-06T14:16:05.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.100+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/675911533 wait complete. 2023-03-06T14:16:05.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.101+0000 7ffb5ce9ab80 20 client.4425 trim_cache size 0 max 16384 2023-03-06T14:16:05.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.118+0000 7ffb5ce9ab80 1 Processor -- start 2023-03-06T14:16:05.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.118+0000 7ffb5ce9ab80 1 -- start start 2023-03-06T14:16:05.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.119+0000 7ffb5ce9ab80 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab91ad0 0x55cc0abc93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.119+0000 7ffb5ce9ab80 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55cc0ab95570 0x55cc0ab8f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.119+0000 7ffb5ce9ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab97410 0x55cc0abcd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.119+0000 7ffb5ce9ab80 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0abccf20 con 0x55cc0ab91ad0 2023-03-06T14:16:05.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.119+0000 7ffb5ce9ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0ab97cc0 con 0x55cc0ab97410 2023-03-06T14:16:05.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.119+0000 7ffb5ce9ab80 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc0abd22e0 con 0x55cc0ab95570 2023-03-06T14:16:05.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.119+0000 7ffb4a59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab91ad0 0x55cc0abc93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.119+0000 7ffb4a59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab91ad0 0x55cc0abc93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55672/0 (socket says 172.21.15.3:55672) 2023-03-06T14:16:05.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.119+0000 7ffb4a59c700 1 -- 172.21.15.3:0/191833274 learned_addr learned my addr 172.21.15.3:0/191833274 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:05.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.119+0000 7ffb4a59c700 1 -- 172.21.15.3:0/191833274 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55cc0ab95570 msgr2=0x55cc0ab8f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:05.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.119+0000 7ffb4a59c700 1 --2- 172.21.15.3:0/191833274 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55cc0ab95570 0x55cc0ab8f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.119+0000 7ffb4a59c700 1 -- 172.21.15.3:0/191833274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab97410 msgr2=0x55cc0abcd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:05.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.119+0000 7ffb4a59c700 1 --2- 172.21.15.3:0/191833274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab97410 0x55cc0abcd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.119+0000 7ffb4a59c700 1 -- 172.21.15.3:0/191833274 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc0aaaf140 con 0x55cc0ab91ad0 2023-03-06T14:16:05.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.119+0000 7ffb4a59c700 1 --2- 172.21.15.3:0/191833274 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab91ad0 0x55cc0abc93b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c006e90 tx=0x7ffb3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7153baca9e59b7 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:05.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.120+0000 7ffb38ff9700 1 -- 172.21.15.3:0/191833274 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c02f070 con 0x55cc0ab91ad0 2023-03-06T14:16:05.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.120+0000 7ffb38ff9700 1 -- 172.21.15.3:0/191833274 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c019070 con 0x55cc0ab91ad0 2023-03-06T14:16:05.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.120+0000 7ffb38ff9700 1 -- 172.21.15.3:0/191833274 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c029070 con 0x55cc0ab91ad0 2023-03-06T14:16:05.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.120+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/191833274 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab91ad0 msgr2=0x55cc0abc93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:05.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.120+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/191833274 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab91ad0 0x55cc0abc93b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c006e90 tx=0x7ffb3c017000 comp rx=0 tx=0).stop 2023-03-06T14:16:05.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.120+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/191833274 shutdown_connections 2023-03-06T14:16:05.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.120+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/191833274 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab91ad0 0x55cc0abc93b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.120+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/191833274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab97410 0x55cc0abcd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.120+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/191833274 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55cc0ab95570 0x55cc0ab8f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.120+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/191833274 >> 172.21.15.3:0/191833274 conn(0x55cc0ab8b720 msgr2=0x55cc0ab945b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:05.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.120+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/191833274 shutdown_connections 2023-03-06T14:16:05.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.120+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/191833274 wait complete. 2023-03-06T14:16:05.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.121+0000 7ffb5ce9ab80 1 -- start start 2023-03-06T14:16:05.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.121+0000 7ffb5ce9ab80 1 Processor -- start 2023-03-06T14:16:05.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb5ce9ab80 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55cc0ab91ad0 0x55cc0abcdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb5ce9ab80 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab95570 0x55cc0abda600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb5ce9ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab97410 0x55cc0abe3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb5ce9ab80 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0ab96df0 con 0x55cc0ab95570 2023-03-06T14:16:05.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb5ce9ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0abdafd0 con 0x55cc0ab97410 2023-03-06T14:16:05.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb5ce9ab80 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc0abca790 con 0x55cc0ab91ad0 2023-03-06T14:16:05.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb5ce9ab80 10 client.0 _ll_register_callbacks cb 0x55cc0aa86630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-06T14:16:05.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb49d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab95570 0x55cc0abda600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb49d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab95570 0x55cc0abda600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55680/0 (socket says 172.21.15.3:55680) 2023-03-06T14:16:05.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb49d9b700 1 -- 172.21.15.3:0/493971878 learned_addr learned my addr 172.21.15.3:0/493971878 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:05.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb4a59c700 1 --2- 172.21.15.3:0/493971878 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55cc0ab91ad0 0x55cc0abcdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb4ad9d700 1 --2- 172.21.15.3:0/493971878 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab97410 0x55cc0abe3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb49d9b700 1 -- 172.21.15.3:0/493971878 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55cc0ab91ad0 msgr2=0x55cc0abcdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:05.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb49d9b700 1 --2- 172.21.15.3:0/493971878 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55cc0ab91ad0 0x55cc0abcdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb49d9b700 1 -- 172.21.15.3:0/493971878 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab97410 msgr2=0x55cc0abe3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:05.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb49d9b700 1 --2- 172.21.15.3:0/493971878 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab97410 0x55cc0abe3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb49d9b700 1 -- 172.21.15.3:0/493971878 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc0a93d200 con 0x55cc0ab95570 2023-03-06T14:16:05.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb4ad9d700 1 --2- 172.21.15.3:0/493971878 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab97410 0x55cc0abe3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:16:05.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb49d9b700 1 --2- 172.21.15.3:0/493971878 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab95570 0x55cc0abda600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffb400575c0 tx=0x7ffb4005f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d71182f22486c1 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:05.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb297fa700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-03-06T14:16:05.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb297fa700 1 -- 172.21.15.3:0/493971878 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb400872b0 con 0x55cc0ab95570 2023-03-06T14:16:05.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb297fa700 1 -- 172.21.15.3:0/493971878 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffb40056b80 con 0x55cc0ab95570 2023-03-06T14:16:05.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/493971878 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc0aaa6160 con 0x55cc0ab95570 2023-03-06T14:16:05.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb297fa700 1 -- 172.21.15.3:0/493971878 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb40056d40 con 0x55cc0ab95570 2023-03-06T14:16:05.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb5ce9ab80 10 client.4431 fetch_fsmap learned FSMap version 7 2023-03-06T14:16:05.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.122+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/493971878 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55cc0a8ffc10 con 0x55cc0ab95570 2023-03-06T14:16:05.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.123+0000 7ffb297fa700 1 -- 172.21.15.3:0/493971878 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cc0aaa6160 con 0x55cc0ab95570 2023-03-06T14:16:05.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.123+0000 7ffb297fa700 1 -- 172.21.15.3:0/493971878 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ffb4005f290 con 0x55cc0ab95570 2023-03-06T14:16:05.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.123+0000 7ffb5ce9ab80 10 client.4431 fetch_fsmap finished waiting for FSMap version 7 2023-03-06T14:16:05.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.123+0000 7ffb5ce9ab80 10 client.4431 resolve_mds: resolved name 'c' to daemon mds.c 2023-03-06T14:16:05.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.123+0000 7ffb5ce9ab80 20 client.4431 populate_metadata read hostname 'smithi003' 2023-03-06T14:16:05.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.123+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/493971878 >> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] conn(0x55cc0abde030 0x55cc0ac2f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.123+0000 7ffb5ce9ab80 4 client.4431 mds_command: new command op to 4287 tid=0[{"prefix": "status"}] 2023-03-06T14:16:05.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.123+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/493971878 --> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cc0aa90170 con 0x55cc0abde030 2023-03-06T14:16:05.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.123+0000 7ffb4a59c700 1 --2- 172.21.15.3:0/493971878 >> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] conn(0x55cc0abde030 0x55cc0ac2f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.123+0000 7ffb297fa700 10 client.4431 ms_handle_connect on v2:172.21.15.3:6833/3655666630 2023-03-06T14:16:05.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.123+0000 7ffb4a59c700 1 --2- 172.21.15.3:0/493971878 >> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] conn(0x55cc0abde030 0x55cc0ac2f630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6ad62418769ba99 server_cookie=7c3c45b7411ad539 in_seq=0 out_seq=0 2023-03-06T14:16:05.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.123+0000 7ffb297fa700 1 -- 172.21.15.3:0/493971878 <== mds.0 v2:172.21.15.3:6833/3655666630 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55cc0aa90170 con 0x55cc0abde030 2023-03-06T14:16:05.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.123+0000 7ffb297fa700 10 client.4431 handle_command_reply: tid=0 2023-03-06T14:16:05.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.123+0000 7ffb5ce9ab80 1 client.4431 shutdown 2023-03-06T14:16:05.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/493971878 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab95570 msgr2=0x55cc0abda600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:05.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/493971878 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab95570 0x55cc0abda600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffb400575c0 tx=0x7ffb4005f7d0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/493971878 shutdown_connections 2023-03-06T14:16:05.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/493971878 >> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] conn(0x55cc0abde030 0x55cc0ac2f630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/493971878 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc0ab97410 0x55cc0abe3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/493971878 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55cc0ab91ad0 0x55cc0abcdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb5ce9ab80 1 --2- 172.21.15.3:0/493971878 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cc0ab95570 0x55cc0abda600 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb297fa700 0 client.4431 ms_handle_reset on v2:172.21.15.3:6833/3655666630 2023-03-06T14:16:05.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/493971878 >> 172.21.15.3:0/493971878 conn(0x55cc0ab8b720 msgr2=0x55cc0abe1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:05.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/493971878 shutdown_connections 2023-03-06T14:16:05.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb5ce9ab80 1 -- 172.21.15.3:0/493971878 wait complete. 2023-03-06T14:16:05.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb5ce9ab80 20 client.4431 trim_cache size 0 max 16384 2023-03-06T14:16:05.152 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-03-06T14:16:05.153 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "9aae2361-5af0-49eb-8f99-e7f69834fedf", 2023-03-06T14:16:05.153 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 0, 2023-03-06T14:16:05.153 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 4287, 2023-03-06T14:16:05.153 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2023-03-06T14:16:05.153 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2023-03-06T14:16:05.153 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2023-03-06T14:16:05.154 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 6.5252511789999996, 2023-03-06T14:16:05.154 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 7, 2023-03-06T14:16:05.154 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 27, 2023-03-06T14:16:05.154 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 26, 2023-03-06T14:16:05.154 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 11.976590565 2023-03-06T14:16:05.154 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-03-06T14:16:05.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb50d11700 1 -- 172.21.15.3:0/110015407 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7ffb2c0682f0 msgr2=0x7ffb2c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:05.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb50d11700 1 --2- 172.21.15.3:0/110015407 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7ffb2c0682f0 0x7ffb2c06a7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c009e40 tx=0x7ffb3c0091c0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb50d11700 1 -- 172.21.15.3:0/110015407 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb4c1504c0 msgr2=0x7ffb4c151a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:05.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb50d11700 1 --2- 172.21.15.3:0/110015407 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb4c1504c0 0x7ffb4c151a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffb400090b0 tx=0x7ffb400047c0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb50d11700 1 -- 172.21.15.3:0/110015407 shutdown_connections 2023-03-06T14:16:05.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb50d11700 1 --2- 172.21.15.3:0/110015407 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7ffb2c0682f0 0x7ffb2c06a7a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb50d11700 1 --2- 172.21.15.3:0/110015407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb4c1e77c0 0x7ffb4c0bb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb50d11700 1 --2- 172.21.15.3:0/110015407 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb34003f80 0x7ffb4c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb50d11700 1 --2- 172.21.15.3:0/110015407 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb4c1504c0 0x7ffb4c151a40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb50d11700 1 -- 172.21.15.3:0/110015407 >> 172.21.15.3:0/110015407 conn(0x7ffb4c0c2150 msgr2=0x7ffb4c0c1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:05.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb50d11700 1 -- 172.21.15.3:0/110015407 shutdown_connections 2023-03-06T14:16:05.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.124+0000 7ffb50d11700 1 -- 172.21.15.3:0/110015407 wait complete. 2023-03-06T14:16:05.158 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-06T14:16:05.159 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-03-06T14:16:05.159 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-06T14:16:05.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.282+0000 7fe4b072f700 1 Processor -- start 2023-03-06T14:16:05.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.282+0000 7fe4b072f700 1 -- start start 2023-03-06T14:16:05.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.283+0000 7fe4b072f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe4a8146d40 0x7fe4a81507d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.283+0000 7fe4b072f700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe4a81471e0 0x7fe4a8150d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.283+0000 7fe4b072f700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a80a3260 con 0x7fe4a806b430 2023-03-06T14:16:05.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.283+0000 7fe4b072f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a806efe0 con 0x7fe4a8146d40 2023-03-06T14:16:05.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.283+0000 7fe4b072f700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a806bf10 con 0x7fe4a81471e0 2023-03-06T14:16:05.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.283+0000 7fe4adcca700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe4a8146d40 0x7fe4a81507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.283+0000 7fe4adcca700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe4a8146d40 0x7fe4a81507d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55688/0 (socket says 172.21.15.3:55688) 2023-03-06T14:16:05.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.283+0000 7fe4adcca700 1 -- 172.21.15.3:0/253078262 learned_addr learned my addr 172.21.15.3:0/253078262 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:05.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.283+0000 7fe4ae4cb700 1 --1- 172.21.15.3:0/253078262 >> v1:172.21.15.3:6789/0 conn(0x7fe4a806b430 0x7fe4a806b800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57958/0 (socket says 172.21.15.3:57958) 2023-03-06T14:16:05.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.284+0000 7fe4aeccc700 1 --2- 172.21.15.3:0/253078262 >> v2:172.21.15.136:3300/0 conn(0x7fe4a81471e0 0x7fe4a8150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.284+0000 7fe4adcca700 1 -- 172.21.15.3:0/253078262 >> v2:172.21.15.136:3300/0 conn(0x7fe4a81471e0 msgr2=0x7fe4a8150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:05.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.284+0000 7fe4adcca700 1 --2- 172.21.15.3:0/253078262 >> v2:172.21.15.136:3300/0 conn(0x7fe4a81471e0 0x7fe4a8150d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.284+0000 7fe4adcca700 1 -- 172.21.15.3:0/253078262 >> v1:172.21.15.3:6789/0 conn(0x7fe4a806b430 legacy=0x7fe4a806b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:05.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.284+0000 7fe4ad4c9700 1 -- 172.21.15.3:0/253078262 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129191873 0 0) 0x7fe4a4001110 con 0x7fe4a806b430 2023-03-06T14:16:05.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.284+0000 7fe4adcca700 1 -- 172.21.15.3:0/253078262 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a814dbf0 con 0x7fe4a8146d40 2023-03-06T14:16:05.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.284+0000 7fe4adcca700 1 --2- 172.21.15.3:0/253078262 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4a8146d40 0x7fe4a81507d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe4a806a8b0 tx=0x7fe49c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53c8056992cc7b8 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:05.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.284+0000 7fe4ad4c9700 1 -- 172.21.15.3:0/253078262 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c00b870 con 0x7fe4a8146d40 2023-03-06T14:16:05.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.284+0000 7fe4ad4c9700 1 -- 172.21.15.3:0/253078262 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c00b9d0 con 0x7fe4a8146d40 2023-03-06T14:16:05.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.284+0000 7fe4ad4c9700 1 -- 172.21.15.3:0/253078262 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c00bd60 con 0x7fe4a8146d40 2023-03-06T14:16:05.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.284+0000 7fe4b072f700 1 -- 172.21.15.3:0/253078262 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4a8146d40 msgr2=0x7fe4a81507d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:05.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.284+0000 7fe4b072f700 1 --2- 172.21.15.3:0/253078262 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4a8146d40 0x7fe4a81507d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe4a806a8b0 tx=0x7fe49c009bd0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.285+0000 7fe4b072f700 1 -- 172.21.15.3:0/253078262 shutdown_connections 2023-03-06T14:16:05.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.285+0000 7fe4b072f700 1 --2- 172.21.15.3:0/253078262 >> v2:172.21.15.136:3300/0 conn(0x7fe4a81471e0 0x7fe4a8150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.285+0000 7fe4b072f700 1 --2- 172.21.15.3:0/253078262 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4a8146d40 0x7fe4a81507d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.285+0000 7fe4b072f700 1 -- 172.21.15.3:0/253078262 >> 172.21.15.3:0/253078262 conn(0x7fe4a80c17d0 msgr2=0x7fe4a80c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:05.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.285+0000 7fe4b072f700 1 -- 172.21.15.3:0/253078262 shutdown_connections 2023-03-06T14:16:05.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.285+0000 7fe4b072f700 1 -- 172.21.15.3:0/253078262 wait complete. 2023-03-06T14:16:05.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.286+0000 7fe4b072f700 1 Processor -- start 2023-03-06T14:16:05.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.286+0000 7fe4b072f700 1 -- start start 2023-03-06T14:16:05.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.286+0000 7fe4b072f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4a806b430 0x7fe4a80c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.286+0000 7fe4b072f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4a8146d40 0x7fe4a81451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.286+0000 7fe4b072f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4a81471e0 0x7fe4a814fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.286+0000 7fe4b072f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a8144a10 con 0x7fe4a806b430 2023-03-06T14:16:05.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.286+0000 7fe4b072f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a8143fc0 con 0x7fe4a8146d40 2023-03-06T14:16:05.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.286+0000 7fe4b072f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a8144580 con 0x7fe4a81471e0 2023-03-06T14:16:05.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.286+0000 7fe4ae4cb700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4a806b430 0x7fe4a80c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.287+0000 7fe4ae4cb700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4a806b430 0x7fe4a80c0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55692/0 (socket says 172.21.15.3:55692) 2023-03-06T14:16:05.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.287+0000 7fe4ae4cb700 1 -- 172.21.15.3:0/1318404503 learned_addr learned my addr 172.21.15.3:0/1318404503 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:05.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.287+0000 7fe4adcca700 1 --2- 172.21.15.3:0/1318404503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4a8146d40 0x7fe4a81451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.287+0000 7fe4aeccc700 1 --2- 172.21.15.3:0/1318404503 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4a81471e0 0x7fe4a814fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.287+0000 7fe4ae4cb700 1 -- 172.21.15.3:0/1318404503 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4a81471e0 msgr2=0x7fe4a814fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:05.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.287+0000 7fe4ae4cb700 1 --2- 172.21.15.3:0/1318404503 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4a81471e0 0x7fe4a814fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.287+0000 7fe4ae4cb700 1 -- 172.21.15.3:0/1318404503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4a8146d40 msgr2=0x7fe4a81451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:05.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.287+0000 7fe4ae4cb700 1 --2- 172.21.15.3:0/1318404503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4a8146d40 0x7fe4a81451a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.287+0000 7fe4ae4cb700 1 -- 172.21.15.3:0/1318404503 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c009550 con 0x7fe4a806b430 2023-03-06T14:16:05.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.287+0000 7fe4ae4cb700 1 --2- 172.21.15.3:0/1318404503 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4a806b430 0x7fe4a80c0fa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400c580 tx=0x7fe4a400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:05.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.287+0000 7fe49affd700 1 -- 172.21.15.3:0/1318404503 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4004c80 con 0x7fe4a806b430 2023-03-06T14:16:05.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.287+0000 7fe49affd700 1 -- 172.21.15.3:0/1318404503 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a4004e00 con 0x7fe4a806b430 2023-03-06T14:16:05.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.287+0000 7fe4b072f700 1 -- 172.21.15.3:0/1318404503 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a806f4d0 con 0x7fe4a806b430 2023-03-06T14:16:05.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.287+0000 7fe49affd700 1 -- 172.21.15.3:0/1318404503 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4007310 con 0x7fe4a806b430 2023-03-06T14:16:05.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.287+0000 7fe4b072f700 1 -- 172.21.15.3:0/1318404503 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a806f1f0 con 0x7fe4a806b430 2023-03-06T14:16:05.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.288+0000 7fe4b072f700 1 -- 172.21.15.3:0/1318404503 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a814d880 con 0x7fe4a806b430 2023-03-06T14:16:05.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.289+0000 7fe49affd700 1 -- 172.21.15.3:0/1318404503 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe4a401a020 con 0x7fe4a806b430 2023-03-06T14:16:05.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.289+0000 7fe49affd700 1 --2- 172.21.15.3:0/1318404503 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fe48c0682f0 0x7fe48c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:05.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.289+0000 7fe49affd700 1 -- 172.21.15.3:0/1318404503 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe4a4085850 con 0x7fe4a806b430 2023-03-06T14:16:05.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.289+0000 7fe4adcca700 1 --2- 172.21.15.3:0/1318404503 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fe48c0682f0 0x7fe48c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:05.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.290+0000 7fe4adcca700 1 --2- 172.21.15.3:0/1318404503 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fe48c0682f0 0x7fe48c06a7a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe49c014040 tx=0x7fe49c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:05.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.293+0000 7fe49affd700 1 -- 172.21.15.3:0/1318404503 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe4a4051d60 con 0x7fe4a806b430 2023-03-06T14:16:05.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.533+0000 7fe4b072f700 1 -- 172.21.15.3:0/1318404503 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe4a80a3260 con 0x7fe4a806b430 2023-03-06T14:16:05.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.533+0000 7fe49affd700 1 -- 172.21.15.3:0/1318404503 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe4a80a3260 con 0x7fe4a806b430 2023-03-06T14:16:05.535 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-03-06T14:16:05.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.535+0000 7fe4b072f700 1 -- 172.21.15.3:0/1318404503 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fe48c0682f0 msgr2=0x7fe48c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:05.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.535+0000 7fe4b072f700 1 --2- 172.21.15.3:0/1318404503 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fe48c0682f0 0x7fe48c06a7a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe49c014040 tx=0x7fe49c008030 comp rx=0 tx=0).stop 2023-03-06T14:16:05.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.535+0000 7fe4b072f700 1 -- 172.21.15.3:0/1318404503 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4a806b430 msgr2=0x7fe4a80c0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:05.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.535+0000 7fe4b072f700 1 --2- 172.21.15.3:0/1318404503 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4a806b430 0x7fe4a80c0fa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400c580 tx=0x7fe4a400c890 comp rx=0 tx=0).stop 2023-03-06T14:16:05.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.535+0000 7fe4b072f700 1 -- 172.21.15.3:0/1318404503 shutdown_connections 2023-03-06T14:16:05.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.535+0000 7fe4b072f700 1 --2- 172.21.15.3:0/1318404503 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fe48c0682f0 0x7fe48c06a7a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.535+0000 7fe4b072f700 1 --2- 172.21.15.3:0/1318404503 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4a806b430 0x7fe4a80c0fa0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.535+0000 7fe4b072f700 1 --2- 172.21.15.3:0/1318404503 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4a81471e0 0x7fe4a814fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.535+0000 7fe4b072f700 1 --2- 172.21.15.3:0/1318404503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4a8146d40 0x7fe4a81451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:05.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.535+0000 7fe4b072f700 1 -- 172.21.15.3:0/1318404503 >> 172.21.15.3:0/1318404503 conn(0x7fe4a80c17d0 msgr2=0x7fe4a806e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:05.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.535+0000 7fe4b072f700 1 -- 172.21.15.3:0/1318404503 shutdown_connections 2023-03-06T14:16:05.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:05.535+0000 7fe4b072f700 1 -- 172.21.15.3:0/1318404503 wait complete. 2023-03-06T14:16:05.548 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-03-06T14:16:05.548 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-06T14:16:05.548 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi003.front.sepia.ceph.com 2023-03-06T14:16:05.549 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-03-06T14:16:05.549 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-03-06T14:16:05.549 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-03-06T14:16:05.549 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-06T14:16:05.550 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-06T14:16:05.551 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-03-06T14:16:05.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:05.552 DEBUG:teuthology.orchestra.run.smithi003:> ip addr 2023-03-06T14:16:05.570 INFO:teuthology.orchestra.run.smithi003.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-06T14:16:05.570 INFO:teuthology.orchestra.run.smithi003.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-06T14:16:05.570 INFO:teuthology.orchestra.run.smithi003.stdout: inet 127.0.0.1/8 scope host lo 2023-03-06T14:16:05.570 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-03-06T14:16:05.571 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 ::1/128 scope host 2023-03-06T14:16:05.571 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-03-06T14:16:05.571 INFO:teuthology.orchestra.run.smithi003.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-06T14:16:05.571 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ac brd ff:ff:ff:ff:ff:ff 2023-03-06T14:16:05.571 INFO:teuthology.orchestra.run.smithi003.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-06T14:16:05.571 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ad brd ff:ff:ff:ff:ff:ff 2023-03-06T14:16:05.571 INFO:teuthology.orchestra.run.smithi003.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-06T14:16:05.572 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dc brd ff:ff:ff:ff:ff:ff 2023-03-06T14:16:05.572 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.21.15.3/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-03-06T14:16:05.572 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft 42498sec preferred_lft 42498sec 2023-03-06T14:16:05.572 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::ec4:7aff:febd:15dc/64 scope link 2023-03-06T14:16:05.572 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-03-06T14:16:05.572 INFO:teuthology.orchestra.run.smithi003.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-06T14:16:05.572 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dd brd ff:ff:ff:ff:ff:ff 2023-03-06T14:16:05.573 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-03-06T14:16:05.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:05.574 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-03-06T14:16:05.574 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-03-06T14:16:05.574 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link add name ceph-brx type bridge 2023-03-06T14:16:05.575 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip addr flush dev ceph-brx 2023-03-06T14:16:05.575 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set ceph-brx up 2023-03-06T14:16:05.575 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-03-06T14:16:05.575 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-03-06T14:16:05.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:05.733 DEBUG:teuthology.orchestra.run.smithi003:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-06T14:16:05.761 INFO:teuthology.orchestra.run.smithi003.stdout:1 2023-03-06T14:16:05.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:05.763 DEBUG:teuthology.orchestra.run.smithi003:> route 2023-03-06T14:16:05.835 INFO:teuthology.orchestra.run.smithi003.stdout:Kernel IP routing table 2023-03-06T14:16:05.836 INFO:teuthology.orchestra.run.smithi003.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-06T14:16:05.836 INFO:teuthology.orchestra.run.smithi003.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-03-06T14:16:05.836 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-03-06T14:16:05.836 INFO:teuthology.orchestra.run.smithi003.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-06T14:16:05.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:05.837 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-03-06T14:16:05.838 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-03-06T14:16:05.838 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-03-06T14:16:05.838 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-03-06T14:16:05.838 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-03-06T14:16:05.839 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-03-06T14:16:06.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:06.139 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2023-03-06T14:16:06.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:06.157 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list-id 2023-03-06T14:16:06.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:06.213 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-03-06T14:16:06.214 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-03-06T14:16:06.214 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-03-06T14:16:06.214 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-03-06T14:16:06.215 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-03-06T14:16:06.308 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-03-06T14:16:06.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:06.310 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-03-06T14:16:06.310 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-03-06T14:16:06.310 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-03-06T14:16:06.310 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-03-06T14:16:06.311 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-03-06T14:16:06.311 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-03-06T14:16:06.311 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-03-06T14:16:06.311 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-03-06T14:16:06.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:06.518 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-03-06T14:16:06.518 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-03-06T14:16:06.519 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set brx.0 up 2023-03-06T14:16:06.519 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set dev brx.0 master ceph-brx 2023-03-06T14:16:06.519 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-03-06T14:16:06.633 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-03-06T14:16:06.634 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-06T14:16:06.634 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-03-06T14:16:06.657 INFO:teuthology.orchestra.run.smithi003.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-03-06T14:16:06.658 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-06T14:16:06.658 DEBUG:teuthology.orchestra.run.smithi003:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-03-06T14:16:06.715 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-03-06T14:16:06.782 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-03-06T14:16:06.783 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-03-06T14:16:06.850 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-03-06T14:16:06.850 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-03-06T14:16:06.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:06.852 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-03-06T14:16:06.908 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-03-06T14:16:06.909 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_mountpoint=/ --client_fs=cephfs) 2023-03-06T14:16:06.951 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-03-06T14:16:06.978 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-03-06T14:16:06.979 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-03-06T14:16:07.044 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-03-06T14:16:07.045 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-03-06T14:16:07.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:07.046 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-03-06T14:16:07.294 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi003.stderr:2023-03-06T14:16:07.292+0000 7feb49c625c0 -1 init, newargv = 0x55f66c488e10 newargc=15 2023-03-06T14:16:07.294 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi003.stderr:ceph-fuse[104663]: starting ceph client 2023-03-06T14:16:07.299 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi003.stderr:ceph-fuse[104663]: starting fuse 2023-03-06T14:16:08.204 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2023-03-06T14:16:08.239 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-03-06T14:16:08.240 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-03-06T14:16:08.309 INFO:teuthology.orchestra.run.smithi003.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-03-06T14:16:08.310 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-03-06T14:16:08.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:08.311 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2023-03-06T14:16:08.369 INFO:teuthology.orchestra.run.smithi003.stdout:47 2023-03-06T14:16:08.369 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-03-06T14:16:08.370 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-03-06T14:16:08.370 DEBUG:teuthology.orchestra.run.smithi003:> import glob 2023-03-06T14:16:08.371 DEBUG:teuthology.orchestra.run.smithi003:> import re 2023-03-06T14:16:08.371 DEBUG:teuthology.orchestra.run.smithi003:> import os 2023-03-06T14:16:08.371 DEBUG:teuthology.orchestra.run.smithi003:> import subprocess 2023-03-06T14:16:08.371 DEBUG:teuthology.orchestra.run.smithi003:> 2023-03-06T14:16:08.372 DEBUG:teuthology.orchestra.run.smithi003:> def _find_admin_socket(client_name): 2023-03-06T14:16:08.372 DEBUG:teuthology.orchestra.run.smithi003:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-03-06T14:16:08.372 DEBUG:teuthology.orchestra.run.smithi003:> files = glob.glob(asok_path) 2023-03-06T14:16:08.373 DEBUG:teuthology.orchestra.run.smithi003:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-03-06T14:16:08.373 DEBUG:teuthology.orchestra.run.smithi003:> 2023-03-06T14:16:08.373 DEBUG:teuthology.orchestra.run.smithi003:> # Given a non-glob path, it better be there 2023-03-06T14:16:08.373 DEBUG:teuthology.orchestra.run.smithi003:> if "*" not in asok_path: 2023-03-06T14:16:08.374 DEBUG:teuthology.orchestra.run.smithi003:> assert(len(files) == 1) 2023-03-06T14:16:08.374 DEBUG:teuthology.orchestra.run.smithi003:> return files[0] 2023-03-06T14:16:08.374 DEBUG:teuthology.orchestra.run.smithi003:> 2023-03-06T14:16:08.374 DEBUG:teuthology.orchestra.run.smithi003:> for f in files: 2023-03-06T14:16:08.375 DEBUG:teuthology.orchestra.run.smithi003:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-03-06T14:16:08.375 DEBUG:teuthology.orchestra.run.smithi003:> if os.path.exists("/proc/{0}".format(pid)): 2023-03-06T14:16:08.375 DEBUG:teuthology.orchestra.run.smithi003:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-03-06T14:16:08.376 DEBUG:teuthology.orchestra.run.smithi003:> contents = proc_f.read() 2023-03-06T14:16:08.376 DEBUG:teuthology.orchestra.run.smithi003:> if mountpoint in contents: 2023-03-06T14:16:08.376 DEBUG:teuthology.orchestra.run.smithi003:> return f 2023-03-06T14:16:08.376 DEBUG:teuthology.orchestra.run.smithi003:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-03-06T14:16:08.377 DEBUG:teuthology.orchestra.run.smithi003:> 2023-03-06T14:16:08.377 DEBUG:teuthology.orchestra.run.smithi003:> print(_find_admin_socket("client.admin")) 2023-03-06T14:16:08.377 DEBUG:teuthology.orchestra.run.smithi003:> ' 2023-03-06T14:16:08.499 INFO:teuthology.orchestra.run.smithi003.stdout:/var/run/ceph/ceph-client.admin.104663.asok 2023-03-06T14:16:08.680 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.104663.asok 2023-03-06T14:16:08.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:08.681 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.104663.asok status 2023-03-06T14:16:08.841 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-03-06T14:16:08.842 INFO:teuthology.orchestra.run.smithi003.stdout: "metadata": { 2023-03-06T14:16:08.842 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_sha1": "472aaef4ec3b3a2c29f73ca67854785a910f1f9b", 2023-03-06T14:16:08.842 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_version": "ceph version 18.0.0-2739-g472aaef4 (472aaef4ec3b3a2c29f73ca67854785a910f1f9b) reef (dev)", 2023-03-06T14:16:08.842 INFO:teuthology.orchestra.run.smithi003.stdout: "entity_id": "admin", 2023-03-06T14:16:08.842 INFO:teuthology.orchestra.run.smithi003.stdout: "hostname": "smithi003", 2023-03-06T14:16:08.842 INFO:teuthology.orchestra.run.smithi003.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-03-06T14:16:08.842 INFO:teuthology.orchestra.run.smithi003.stdout: "pid": "104663", 2023-03-06T14:16:08.843 INFO:teuthology.orchestra.run.smithi003.stdout: "root": "/" 2023-03-06T14:16:08.843 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-03-06T14:16:08.843 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_count": 0, 2023-03-06T14:16:08.843 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_pinned_count": 0, 2023-03-06T14:16:08.843 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 4446, 2023-03-06T14:16:08.843 INFO:teuthology.orchestra.run.smithi003.stdout: "inst": { 2023-03-06T14:16:08.843 INFO:teuthology.orchestra.run.smithi003.stdout: "name": { 2023-03-06T14:16:08.844 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client", 2023-03-06T14:16:08.844 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 4446 2023-03-06T14:16:08.844 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-03-06T14:16:08.844 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2023-03-06T14:16:08.844 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-03-06T14:16:08.844 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.1:0", 2023-03-06T14:16:08.844 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 1941545223 2023-03-06T14:16:08.844 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-03-06T14:16:08.845 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-03-06T14:16:08.845 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2023-03-06T14:16:08.845 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2023-03-06T14:16:08.845 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.1:0", 2023-03-06T14:16:08.845 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 1941545223 2023-03-06T14:16:08.845 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-03-06T14:16:08.846 INFO:teuthology.orchestra.run.smithi003.stdout: "inst_str": "client.4446 192.168.0.1:0/1941545223", 2023-03-06T14:16:08.846 INFO:teuthology.orchestra.run.smithi003.stdout: "addr_str": "192.168.0.1:0/1941545223", 2023-03-06T14:16:08.846 INFO:teuthology.orchestra.run.smithi003.stdout: "inode_count": 1, 2023-03-06T14:16:08.846 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_epoch": 7, 2023-03-06T14:16:08.846 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch": 27, 2023-03-06T14:16:08.847 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch_barrier": 0, 2023-03-06T14:16:08.847 INFO:teuthology.orchestra.run.smithi003.stdout: "blocklisted": false, 2023-03-06T14:16:08.847 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs" 2023-03-06T14:16:08.847 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-03-06T14:16:08.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:08.852 DEBUG:teuthology.orchestra.run.smithi003:> stat --file-system '--printf=%T 2023-03-06T14:16:08.852 DEBUG:teuthology.orchestra.run.smithi003:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-03-06T14:16:08.870 INFO:teuthology.orchestra.run.smithi003.stdout:fuseblk 2023-03-06T14:16:08.870 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-03-06T14:16:08.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:08.871 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-03-06T14:16:08.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:08.938 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-03-06T14:16:09.039 INFO:teuthology.orchestra.run.smithi003.stdout:# file: . 2023-03-06T14:16:09.039 INFO:teuthology.orchestra.run.smithi003.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-03-06T14:16:09.040 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:09.040 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:16:09.040 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-06T14:16:09.059 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T14:16:09.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.222+0000 7fc049084700 1 Processor -- start 2023-03-06T14:16:09.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.222+0000 7fc049084700 1 -- start start 2023-03-06T14:16:09.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.222+0000 7fc049084700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc04406b4c0 0x7fc04406de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:09.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.222+0000 7fc049084700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc04406b890 0x7fc04406e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:09.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.223+0000 7fc049084700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc044150d60 con 0x7fc04406cee0 2023-03-06T14:16:09.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.223+0000 7fc049084700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0440bb9c0 con 0x7fc04406b890 2023-03-06T14:16:09.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.223+0000 7fc049084700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440ba9c0 con 0x7fc04406b4c0 2023-03-06T14:16:09.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.223+0000 7fc04359e700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fc04406cee0 0x7fc04414d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:57990/0 (socket says 172.21.15.3:57990) 2023-03-06T14:16:09.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.223+0000 7fc04359e700 1 -- 172.21.15.3:0/2934693559 learned_addr learned my addr 172.21.15.3:0/2934693559 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:09.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.223+0000 7fc04259c700 1 --2- 172.21.15.3:0/2934693559 >> v2:172.21.15.136:3300/0 conn(0x7fc04406b890 0x7fc04406e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:09.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.223+0000 7fc042d9d700 1 --2- 172.21.15.3:0/2934693559 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc04406b4c0 0x7fc04406de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:09.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.223+0000 7fc041d9b700 1 -- 172.21.15.3:0/2934693559 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541682191 0 0) 0x7fc044150d60 con 0x7fc04406cee0 2023-03-06T14:16:09.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.223+0000 7fc041d9b700 1 -- 172.21.15.3:0/2934693559 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc02c0035b0 con 0x7fc04406cee0 2023-03-06T14:16:09.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.223+0000 7fc04259c700 1 -- 172.21.15.3:0/2934693559 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc04406b4c0 msgr2=0x7fc04406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:09.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.223+0000 7fc04259c700 1 --2- 172.21.15.3:0/2934693559 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc04406b4c0 0x7fc04406de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.223+0000 7fc04259c700 1 -- 172.21.15.3:0/2934693559 >> v1:172.21.15.3:6789/0 conn(0x7fc04406cee0 legacy=0x7fc04414d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:09.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.223+0000 7fc04259c700 1 -- 172.21.15.3:0/2934693559 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc044151000 con 0x7fc04406b890 2023-03-06T14:16:09.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.223+0000 7fc042d9d700 1 --2- 172.21.15.3:0/2934693559 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc04406b4c0 0x7fc04406de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:16:09.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.223+0000 7fc04259c700 1 --2- 172.21.15.3:0/2934693559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc04406b890 0x7fc04406e790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc038009840 tx=0x7fc038009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a15d22524d7e9469 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:09.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.224+0000 7fc041d9b700 1 -- 172.21.15.3:0/2934693559 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038011830 con 0x7fc04406b890 2023-03-06T14:16:09.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.224+0000 7fc041d9b700 1 -- 172.21.15.3:0/2934693559 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc038011990 con 0x7fc04406b890 2023-03-06T14:16:09.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.224+0000 7fc041d9b700 1 -- 172.21.15.3:0/2934693559 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038011d00 con 0x7fc04406b890 2023-03-06T14:16:09.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.224+0000 7fc049084700 1 -- 172.21.15.3:0/2934693559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc04406b890 msgr2=0x7fc04406e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:09.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.224+0000 7fc049084700 1 --2- 172.21.15.3:0/2934693559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc04406b890 0x7fc04406e790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc038009840 tx=0x7fc038009b50 comp rx=0 tx=0).stop 2023-03-06T14:16:09.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.224+0000 7fc049084700 1 -- 172.21.15.3:0/2934693559 shutdown_connections 2023-03-06T14:16:09.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.224+0000 7fc049084700 1 --2- 172.21.15.3:0/2934693559 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc04406b4c0 0x7fc04406de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.224+0000 7fc049084700 1 --2- 172.21.15.3:0/2934693559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc04406b890 0x7fc04406e790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.224+0000 7fc049084700 1 -- 172.21.15.3:0/2934693559 >> 172.21.15.3:0/2934693559 conn(0x7fc0440c0eb0 msgr2=0x7fc0440c12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:09.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.224+0000 7fc049084700 1 -- 172.21.15.3:0/2934693559 shutdown_connections 2023-03-06T14:16:09.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.224+0000 7fc049084700 1 -- 172.21.15.3:0/2934693559 wait complete. 2023-03-06T14:16:09.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.226+0000 7fc049084700 1 Processor -- start 2023-03-06T14:16:09.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.226+0000 7fc049084700 1 -- start start 2023-03-06T14:16:09.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.226+0000 7fc049084700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc04406b4c0 0x7fc0440b98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:09.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.226+0000 7fc049084700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc04406b890 0x7fc0440b9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:09.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.226+0000 7fc049084700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc04406cee0 0x7fc044146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:09.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.226+0000 7fc049084700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc044099270 con 0x7fc04406b890 2023-03-06T14:16:09.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.226+0000 7fc049084700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440b8ee0 con 0x7fc04406cee0 2023-03-06T14:16:09.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.226+0000 7fc049084700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc044098a60 con 0x7fc04406b4c0 2023-03-06T14:16:09.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.226+0000 7fc04259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc04406b890 0x7fc0440b9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:09.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.226+0000 7fc04259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc04406b890 0x7fc0440b9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55722/0 (socket says 172.21.15.3:55722) 2023-03-06T14:16:09.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.226+0000 7fc04259c700 1 -- 172.21.15.3:0/3481018429 learned_addr learned my addr 172.21.15.3:0/3481018429 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:09.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.227+0000 7fc042d9d700 1 --2- 172.21.15.3:0/3481018429 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc04406b4c0 0x7fc0440b98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:09.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.227+0000 7fc04359e700 1 --2- 172.21.15.3:0/3481018429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc04406cee0 0x7fc044146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:09.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.227+0000 7fc04259c700 1 -- 172.21.15.3:0/3481018429 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc04406b4c0 msgr2=0x7fc0440b98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:09.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.227+0000 7fc04259c700 1 --2- 172.21.15.3:0/3481018429 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc04406b4c0 0x7fc0440b98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.227+0000 7fc04259c700 1 -- 172.21.15.3:0/3481018429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc04406cee0 msgr2=0x7fc044146110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:09.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.227+0000 7fc04259c700 1 --2- 172.21.15.3:0/3481018429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc04406cee0 0x7fc044146110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.227+0000 7fc04259c700 1 -- 172.21.15.3:0/3481018429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0340094a0 con 0x7fc04406b890 2023-03-06T14:16:09.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.227+0000 7fc04359e700 1 --2- 172.21.15.3:0/3481018429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc04406cee0 0x7fc044146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:16:09.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.227+0000 7fc04259c700 1 --2- 172.21.15.3:0/3481018429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc04406b890 0x7fc0440b9e30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc0380090b0 tx=0x7fc038004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:09.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.227+0000 7fc02b7fe700 1 -- 172.21.15.3:0/3481018429 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0380045d0 con 0x7fc04406b890 2023-03-06T14:16:09.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.227+0000 7fc02b7fe700 1 -- 172.21.15.3:0/3481018429 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03801f070 con 0x7fc04406b890 2023-03-06T14:16:09.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.227+0000 7fc02b7fe700 1 -- 172.21.15.3:0/3481018429 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0380038a0 con 0x7fc04406b890 2023-03-06T14:16:09.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.227+0000 7fc049084700 1 -- 172.21.15.3:0/3481018429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0380094a0 con 0x7fc04406b890 2023-03-06T14:16:09.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.227+0000 7fc049084700 1 -- 172.21.15.3:0/3481018429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04414ce30 con 0x7fc04406b890 2023-03-06T14:16:09.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.228+0000 7fc049084700 1 -- 172.21.15.3:0/3481018429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04414dca0 con 0x7fc04406b890 2023-03-06T14:16:09.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.229+0000 7fc02b7fe700 1 -- 172.21.15.3:0/3481018429 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc03800f050 con 0x7fc04406b890 2023-03-06T14:16:09.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.229+0000 7fc02b7fe700 1 --2- 172.21.15.3:0/3481018429 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0300682f0 0x7fc03006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:09.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.229+0000 7fc02b7fe700 1 -- 172.21.15.3:0/3481018429 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc038021070 con 0x7fc04406b890 2023-03-06T14:16:09.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.229+0000 7fc042d9d700 1 --2- 172.21.15.3:0/3481018429 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0300682f0 0x7fc03006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:09.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.230+0000 7fc042d9d700 1 --2- 172.21.15.3:0/3481018429 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0300682f0 0x7fc03006a7a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc034009d00 tx=0x7fc034008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:09.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.234+0000 7fc02b7fe700 1 -- 172.21.15.3:0/3481018429 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc038053d90 con 0x7fc04406b890 2023-03-06T14:16:09.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.428+0000 7fc049084700 1 -- 172.21.15.3:0/3481018429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc04406ecd0 con 0x7fc04406b890 2023-03-06T14:16:09.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.429+0000 7fc02b7fe700 1 -- 172.21.15.3:0/3481018429 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19604 (secure 0 0 0) 0x7fc0380573b0 con 0x7fc04406b890 2023-03-06T14:16:09.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:09.431 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":27,"fsid":"9aae2361-5af0-49eb-8f99-e7f69834fedf","created":"2023-03-06T14:15:33.357348+0000","modified":"2023-03-06T14:16:03.040402+0000","last_up_change":"2023-03-06T14:15:44.374764+0000","last_in_change":"2023-03-06T14:15:35.866803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T14:15:45.023761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T14:15:51.830917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-06T14:15:56.256188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-06T14:15:57.571429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-06T14:16:00.645210+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c92c9e49-8a23-48a5-87e5-51f184f73a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":96679},{"type":"v1","addr":"172.21.15.3:6809","nonce":96679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":96679},{"type":"v1","addr":"172.21.15.3:6811","nonce":96679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":96679},{"type":"v1","addr":"172.21.15.3:6818","nonce":96679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":96679},{"type":"v1","addr":"172.21.15.3:6814","nonce":96679}]},"public_addr":"172.21.15.3:6809/96679","cluster_addr":"172.21.15.3:6811/96679","heartbeat_back_addr":"172.21.15.3:6818/96679","heartbeat_front_addr":"172.21.15.3:6814/96679","state":["exists","up"]},{"osd":1,"uuid":"86ec9127-843f-4246-bfbe-e14ce3af7d17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":96681},{"type":"v1","addr":"172.21.15.3:6825","nonce":96681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":96681},{"type":"v1","addr":"172.21.15.3:6827","nonce":96681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":96681},{"type":"v1","addr":"172.21.15.3:6831","nonce":96681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":96681},{"type":"v1","addr":"172.21.15.3:6829","nonce":96681}]},"public_addr":"172.21.15.3:6825/96681","cluster_addr":"172.21.15.3:6827/96681","heartbeat_back_addr":"172.21.15.3:6831/96681","heartbeat_front_addr":"172.21.15.3:6829/96681","state":["exists","up"]},{"osd":2,"uuid":"67582de3-0f75-4cf0-84ca-e878986f99f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":96682},{"type":"v1","addr":"172.21.15.3:6815","nonce":96682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6817","nonce":96682},{"type":"v1","addr":"172.21.15.3:6819","nonce":96682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":96682},{"type":"v1","addr":"172.21.15.3:6823","nonce":96682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":96682},{"type":"v1","addr":"172.21.15.3:6821","nonce":96682}]},"public_addr":"172.21.15.3:6815/96682","cluster_addr":"172.21.15.3:6819/96682","heartbeat_back_addr":"172.21.15.3:6823/96682","heartbeat_front_addr":"172.21.15.3:6821/96682","state":["exists","up"]},{"osd":3,"uuid":"0fb8d708-4b38-4153-8a60-79741765d439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":96680},{"type":"v1","addr":"172.21.15.3:6801","nonce":96680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":96680},{"type":"v1","addr":"172.21.15.3:6803","nonce":96680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":96680},{"type":"v1","addr":"172.21.15.3:6807","nonce":96680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":96680},{"type":"v1","addr":"172.21.15.3:6805","nonce":96680}]},"public_addr":"172.21.15.3:6801/96680","cluster_addr":"172.21.15.3:6803/96680","heartbeat_back_addr":"172.21.15.3:6807/96680","heartbeat_front_addr":"172.21.15.3:6805/96680","state":["exists","up"]},{"osd":4,"uuid":"44eb9d99-975f-43a3-8bf4-213b2ba6dea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":96798},{"type":"v1","addr":"172.21.15.136:6822","nonce":96798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":96798},{"type":"v1","addr":"172.21.15.136:6826","nonce":96798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":96798},{"type":"v1","addr":"172.21.15.136:6831","nonce":96798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":96798},{"type":"v1","addr":"172.21.15.136:6829","nonce":96798}]},"public_addr":"172.21.15.136:6822/96798","cluster_addr":"172.21.15.136:6826/96798","heartbeat_back_addr":"172.21.15.136:6831/96798","heartbeat_front_addr":"172.21.15.136:6829/96798","state":["exists","up"]},{"osd":5,"uuid":"aff1a438-c444-4ebc-9806-d2d117878a2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":96796},{"type":"v1","addr":"172.21.15.136:6804","nonce":96796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":96796},{"type":"v1","addr":"172.21.15.136:6809","nonce":96796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":96796},{"type":"v1","addr":"172.21.15.136:6815","nonce":96796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":96796},{"type":"v1","addr":"172.21.15.136:6813","nonce":96796}]},"public_addr":"172.21.15.136:6804/96796","cluster_addr":"172.21.15.136:6809/96796","heartbeat_back_addr":"172.21.15.136:6815/96796","heartbeat_front_addr":"172.21.15.136:6813/96796","state":["exists","up"]},{"osd":6,"uuid":"89cc219c-f57b-43f4-8e54-76017dd4930d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":96797},{"type":"v1","addr":"172.21.15.136:6801","nonce":96797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6803","nonce":96797},{"type":"v1","addr":"172.21.15.136:6805","nonce":96797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":96797},{"type":"v1","addr":"172.21.15.136:6811","nonce":96797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":96797},{"type":"v1","addr":"172.21.15.136:6808","nonce":96797}]},"public_addr":"172.21.15.136:6801/96797","cluster_addr":"172.21.15.136:6805/96797","heartbeat_back_addr":"172.21.15.136:6811/96797","heartbeat_front_addr":"172.21.15.136:6808/96797","state":["exists","up"]},{"osd":7,"uuid":"a90e4c14-00de-4d1c-92ce-9f20df714e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":96819},{"type":"v1","addr":"172.21.15.136:6817","nonce":96819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":96819},{"type":"v1","addr":"172.21.15.136:6819","nonce":96819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":96819},{"type":"v1","addr":"172.21.15.136:6827","nonce":96819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":96819},{"type":"v1","addr":"172.21.15.136:6823","nonce":96819}]},"public_addr":"172.21.15.136:6817/96819","cluster_addr":"172.21.15.136:6819/96819","heartbeat_back_addr":"172.21.15.136:6827/96819","heartbeat_front_addr":"172.21.15.136:6823/96819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.093141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.034488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.128137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.097924+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.045441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.005820+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.039918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.082053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T14:16:09.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.432+0000 7fc049084700 1 -- 172.21.15.3:0/3481018429 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0300682f0 msgr2=0x7fc03006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:09.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.432+0000 7fc049084700 1 --2- 172.21.15.3:0/3481018429 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0300682f0 0x7fc03006a7a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc034009d00 tx=0x7fc034008040 comp rx=0 tx=0).stop 2023-03-06T14:16:09.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.432+0000 7fc049084700 1 -- 172.21.15.3:0/3481018429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc04406b890 msgr2=0x7fc0440b9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:09.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.432+0000 7fc049084700 1 --2- 172.21.15.3:0/3481018429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc04406b890 0x7fc0440b9e30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc0380090b0 tx=0x7fc038004750 comp rx=0 tx=0).stop 2023-03-06T14:16:09.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.432+0000 7fc049084700 1 -- 172.21.15.3:0/3481018429 shutdown_connections 2023-03-06T14:16:09.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.432+0000 7fc049084700 1 --2- 172.21.15.3:0/3481018429 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0300682f0 0x7fc03006a7a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.432+0000 7fc049084700 1 --2- 172.21.15.3:0/3481018429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc04406cee0 0x7fc044146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.432+0000 7fc049084700 1 --2- 172.21.15.3:0/3481018429 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc04406b4c0 0x7fc0440b98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.432+0000 7fc049084700 1 --2- 172.21.15.3:0/3481018429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc04406b890 0x7fc0440b9e30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.432+0000 7fc049084700 1 -- 172.21.15.3:0/3481018429 >> 172.21.15.3:0/3481018429 conn(0x7fc0440c0eb0 msgr2=0x7fc04414bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:09.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.432+0000 7fc049084700 1 -- 172.21.15.3:0/3481018429 shutdown_connections 2023-03-06T14:16:09.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.432+0000 7fc049084700 1 -- 172.21.15.3:0/3481018429 wait complete. 2023-03-06T14:16:09.446 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-06T14:15:45.023761+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-06T14:15:51.830917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-06T14:15:56.256188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-06T14:15:57.571429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-06T14:16:00.645210+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-06T14:16:09.447 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-06T14:16:09.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.574+0000 7f96b920a700 1 Processor -- start 2023-03-06T14:16:09.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.574+0000 7f96b920a700 1 -- start start 2023-03-06T14:16:09.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.574+0000 7f96b920a700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96b406ea70 0x7f96b40bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:09.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.574+0000 7f96b920a700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f96b406ee40 0x7f96b41490f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:09.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.574+0000 7f96b920a700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b414ff80 con 0x7f96b40bdd60 2023-03-06T14:16:09.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.574+0000 7f96b920a700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b40b9070 con 0x7f96b406ee40 2023-03-06T14:16:09.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.574+0000 7f96b920a700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b40bcb90 con 0x7f96b406ea70 2023-03-06T14:16:09.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.575+0000 7f96b259c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f96b406ee40 0x7f96b41490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:09.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.575+0000 7f96b259c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f96b406ee40 0x7f96b41490f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55728/0 (socket says 172.21.15.3:55728) 2023-03-06T14:16:09.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.575+0000 7f96b259c700 1 -- 172.21.15.3:0/1126782281 learned_addr learned my addr 172.21.15.3:0/1126782281 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:09.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.575+0000 7f96b2d9d700 1 --2- 172.21.15.3:0/1126782281 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96b406ea70 0x7f96b40bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:09.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.575+0000 7f96b259c700 1 -- 172.21.15.3:0/1126782281 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96b406ea70 msgr2=0x7f96b40bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:09.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.575+0000 7f96b259c700 1 --2- 172.21.15.3:0/1126782281 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96b406ea70 0x7f96b40bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.575+0000 7f96b259c700 1 -- 172.21.15.3:0/1126782281 >> v1:172.21.15.136:6789/0 conn(0x7f96b40bdd60 legacy=0x7f96b406c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:09.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.575+0000 7f96b259c700 1 -- 172.21.15.3:0/1126782281 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b40bce70 con 0x7f96b406ee40 2023-03-06T14:16:09.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.575+0000 7f96b2d9d700 1 --2- 172.21.15.3:0/1126782281 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96b406ea70 0x7f96b40bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:09.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.575+0000 7f96b259c700 1 --2- 172.21.15.3:0/1126782281 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f96b406ee40 0x7f96b41490f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f96a80098f0 tx=0x7f96a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e6a3402838b9bd server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:09.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.575+0000 7f96b1d9b700 1 -- 172.21.15.3:0/1126782281 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a800b8a0 con 0x7f96b406ee40 2023-03-06T14:16:09.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.575+0000 7f96b1d9b700 1 -- 172.21.15.3:0/1126782281 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a800ba00 con 0x7f96b406ee40 2023-03-06T14:16:09.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.575+0000 7f96b1d9b700 1 -- 172.21.15.3:0/1126782281 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a800bd90 con 0x7f96b406ee40 2023-03-06T14:16:09.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.576+0000 7f96b920a700 1 -- 172.21.15.3:0/1126782281 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f96b406ee40 msgr2=0x7f96b41490f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:09.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.576+0000 7f96b920a700 1 --2- 172.21.15.3:0/1126782281 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f96b406ee40 0x7f96b41490f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f96a80098f0 tx=0x7f96a8009c00 comp rx=0 tx=0).stop 2023-03-06T14:16:09.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.576+0000 7f96b920a700 1 -- 172.21.15.3:0/1126782281 shutdown_connections 2023-03-06T14:16:09.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.576+0000 7f96b920a700 1 --2- 172.21.15.3:0/1126782281 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96b406ea70 0x7f96b40bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.576+0000 7f96b920a700 1 --2- 172.21.15.3:0/1126782281 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f96b406ee40 0x7f96b41490f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.576+0000 7f96b920a700 1 -- 172.21.15.3:0/1126782281 >> 172.21.15.3:0/1126782281 conn(0x7f96b40c2150 msgr2=0x7f96b40c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:09.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.576+0000 7f96b920a700 1 -- 172.21.15.3:0/1126782281 shutdown_connections 2023-03-06T14:16:09.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.576+0000 7f96b920a700 1 -- 172.21.15.3:0/1126782281 wait complete. 2023-03-06T14:16:09.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.577+0000 7f96b920a700 1 Processor -- start 2023-03-06T14:16:09.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.577+0000 7f96b920a700 1 -- start start 2023-03-06T14:16:09.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.578+0000 7f96b920a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96b406ea70 0x7f96b414ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:09.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.578+0000 7f96b920a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f96b406ee40 0x7f96b40ba760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:09.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.578+0000 7f96b920a700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96b40bdd60 0x7f96b40baca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:09.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.578+0000 7f96b920a700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b40a79d0 con 0x7f96b406ee40 2023-03-06T14:16:09.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.578+0000 7f96b920a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b414f010 con 0x7f96b406ea70 2023-03-06T14:16:09.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.578+0000 7f96b920a700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b41e4eb0 con 0x7f96b40bdd60 2023-03-06T14:16:09.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.578+0000 7f96b259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f96b406ee40 0x7f96b40ba760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:09.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.578+0000 7f96b259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f96b406ee40 0x7f96b40ba760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55736/0 (socket says 172.21.15.3:55736) 2023-03-06T14:16:09.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.578+0000 7f96b259c700 1 -- 172.21.15.3:0/1456448252 learned_addr learned my addr 172.21.15.3:0/1456448252 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:09.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.578+0000 7f96b2d9d700 1 --2- 172.21.15.3:0/1456448252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96b406ea70 0x7f96b414ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:09.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.578+0000 7f96b359e700 1 --2- 172.21.15.3:0/1456448252 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96b40bdd60 0x7f96b40baca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:09.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.579+0000 7f96b259c700 1 -- 172.21.15.3:0/1456448252 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96b40bdd60 msgr2=0x7f96b40baca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:09.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.579+0000 7f96b259c700 1 --2- 172.21.15.3:0/1456448252 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96b40bdd60 0x7f96b40baca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.579+0000 7f96b259c700 1 -- 172.21.15.3:0/1456448252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96b406ea70 msgr2=0x7f96b414ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:09.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.579+0000 7f96b259c700 1 --2- 172.21.15.3:0/1456448252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96b406ea70 0x7f96b414ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.579+0000 7f96b259c700 1 -- 172.21.15.3:0/1456448252 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a8009550 con 0x7f96b406ee40 2023-03-06T14:16:09.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.579+0000 7f96b259c700 1 --2- 172.21.15.3:0/1456448252 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f96b406ee40 0x7f96b40ba760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f96a8000c00 tx=0x7f96a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:09.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.579+0000 7f969b7fe700 1 -- 172.21.15.3:0/1456448252 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a8004300 con 0x7f96b406ee40 2023-03-06T14:16:09.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.579+0000 7f969b7fe700 1 -- 172.21.15.3:0/1456448252 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a801f070 con 0x7f96b406ee40 2023-03-06T14:16:09.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.579+0000 7f96b920a700 1 -- 172.21.15.3:0/1456448252 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b4150220 con 0x7f96b406ee40 2023-03-06T14:16:09.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.579+0000 7f969b7fe700 1 -- 172.21.15.3:0/1456448252 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a80036a0 con 0x7f96b406ee40 2023-03-06T14:16:09.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.579+0000 7f96b920a700 1 -- 172.21.15.3:0/1456448252 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b40bd150 con 0x7f96b406ee40 2023-03-06T14:16:09.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.580+0000 7f96b920a700 1 -- 172.21.15.3:0/1456448252 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b406ca90 con 0x7f96b406ee40 2023-03-06T14:16:09.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.580+0000 7f969b7fe700 1 -- 172.21.15.3:0/1456448252 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f96a802a020 con 0x7f96b406ee40 2023-03-06T14:16:09.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.581+0000 7f969b7fe700 1 --2- 172.21.15.3:0/1456448252 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f96a00682f0 0x7f96a006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:09.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.581+0000 7f969b7fe700 1 -- 172.21.15.3:0/1456448252 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f96a8087450 con 0x7f96b406ee40 2023-03-06T14:16:09.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.581+0000 7f96b2d9d700 1 --2- 172.21.15.3:0/1456448252 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f96a00682f0 0x7f96a006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:09.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.582+0000 7f96b2d9d700 1 --2- 172.21.15.3:0/1456448252 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f96a00682f0 0x7f96a006a7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f96a40099c0 tx=0x7f96a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:09.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.585+0000 7f969b7fe700 1 -- 172.21.15.3:0/1456448252 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f96a8053940 con 0x7f96b406ee40 2023-03-06T14:16:09.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.777+0000 7f96b920a700 1 -- 172.21.15.3:0/1456448252 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96b40675f0 con 0x7f96b406ee40 2023-03-06T14:16:09.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.777+0000 7f969b7fe700 1 -- 172.21.15.3:0/1456448252 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96a8056f60 con 0x7f96b406ee40 2023-03-06T14:16:09.779 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-03-06T14:16:09.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.779+0000 7f96b920a700 1 -- 172.21.15.3:0/1456448252 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f96a00682f0 msgr2=0x7f96a006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:09.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.779+0000 7f96b920a700 1 --2- 172.21.15.3:0/1456448252 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f96a00682f0 0x7f96a006a7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f96a40099c0 tx=0x7f96a4008040 comp rx=0 tx=0).stop 2023-03-06T14:16:09.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.779+0000 7f96b920a700 1 -- 172.21.15.3:0/1456448252 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f96b406ee40 msgr2=0x7f96b40ba760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:09.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.779+0000 7f96b920a700 1 --2- 172.21.15.3:0/1456448252 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f96b406ee40 0x7f96b40ba760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f96a8000c00 tx=0x7f96a8004750 comp rx=0 tx=0).stop 2023-03-06T14:16:09.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.779+0000 7f96b920a700 1 -- 172.21.15.3:0/1456448252 shutdown_connections 2023-03-06T14:16:09.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.779+0000 7f96b920a700 1 --2- 172.21.15.3:0/1456448252 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f96a00682f0 0x7f96a006a7a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.779+0000 7f96b920a700 1 --2- 172.21.15.3:0/1456448252 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96b40bdd60 0x7f96b40baca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.779+0000 7f96b920a700 1 --2- 172.21.15.3:0/1456448252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96b406ea70 0x7f96b414ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.779+0000 7f96b920a700 1 --2- 172.21.15.3:0/1456448252 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f96b406ee40 0x7f96b40ba760 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.779+0000 7f96b920a700 1 -- 172.21.15.3:0/1456448252 >> 172.21.15.3:0/1456448252 conn(0x7f96b40c2150 msgr2=0x7f96b406cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:09.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.779+0000 7f96b920a700 1 -- 172.21.15.3:0/1456448252 shutdown_connections 2023-03-06T14:16:09.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.779+0000 7f96b920a700 1 -- 172.21.15.3:0/1456448252 wait complete. 2023-03-06T14:16:09.793 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-06T14:16:09.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.918+0000 7f3505bbc700 1 Processor -- start 2023-03-06T14:16:09.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.918+0000 7f3505bbc700 1 -- start start 2023-03-06T14:16:09.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.919+0000 7f3505bbc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3500146130 0x7f350014f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:09.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.919+0000 7f3505bbc700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f350014fab0 con 0x7f35000b9070 2023-03-06T14:16:09.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.919+0000 7f3505bbc700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f350006fc80 con 0x7f35000b8140 2023-03-06T14:16:09.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.919+0000 7f3505bbc700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f350014cb30 con 0x7f3500146130 2023-03-06T14:16:09.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.919+0000 7f34ff7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3500146130 0x7f350014f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:09.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.919+0000 7f34fffff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f35000b9070 0x7f3500156900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58018/0 (socket says 172.21.15.3:58018) 2023-03-06T14:16:09.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.919+0000 7f34ff7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3500146130 0x7f350014f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55742/0 (socket says 172.21.15.3:55742) 2023-03-06T14:16:09.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.919+0000 7f34fffff700 1 -- 172.21.15.3:0/3152613517 learned_addr learned my addr 172.21.15.3:0/3152613517 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:09.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.920+0000 7f34ff7fe700 1 -- 172.21.15.3:0/3152613517 >> v1:172.21.15.136:6789/0 conn(0x7f35000b8140 legacy=0x7f350006e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:09.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.920+0000 7f34ff7fe700 1 -- 172.21.15.3:0/3152613517 >> v1:172.21.15.3:6789/0 conn(0x7f35000b9070 legacy=0x7f3500156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:09.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.920+0000 7f34fe7fc700 1 -- 172.21.15.3:0/3152613517 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165309171 0 0) 0x7f350014fab0 con 0x7f35000b9070 2023-03-06T14:16:09.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.920+0000 7f34ff7fe700 1 -- 172.21.15.3:0/3152613517 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350006f520 con 0x7f3500146130 2023-03-06T14:16:09.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.920+0000 7f34ff7fe700 1 --2- 172.21.15.3:0/3152613517 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3500146130 0x7f350014f570 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009820 tx=0x7f34f0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e5763b0dd8274a server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:09.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.920+0000 7f34fe7fc700 1 -- 172.21.15.3:0/3152613517 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f0005e30 con 0x7f3500146130 2023-03-06T14:16:09.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.920+0000 7f34fe7fc700 1 -- 172.21.15.3:0/3152613517 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f0004030 con 0x7f3500146130 2023-03-06T14:16:09.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.920+0000 7f34fe7fc700 1 -- 172.21.15.3:0/3152613517 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f00043c0 con 0x7f3500146130 2023-03-06T14:16:09.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.920+0000 7f3505bbc700 1 -- 172.21.15.3:0/3152613517 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3500146130 msgr2=0x7f350014f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:09.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.920+0000 7f3505bbc700 1 --2- 172.21.15.3:0/3152613517 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3500146130 0x7f350014f570 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009820 tx=0x7f34f0009b30 comp rx=0 tx=0).stop 2023-03-06T14:16:09.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.921+0000 7f3505bbc700 1 -- 172.21.15.3:0/3152613517 shutdown_connections 2023-03-06T14:16:09.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.921+0000 7f3505bbc700 1 --2- 172.21.15.3:0/3152613517 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3500146130 0x7f350014f570 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.921+0000 7f3505bbc700 1 -- 172.21.15.3:0/3152613517 >> 172.21.15.3:0/3152613517 conn(0x7f35000c2150 msgr2=0x7f35000c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:09.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.921+0000 7f3505bbc700 1 -- 172.21.15.3:0/3152613517 shutdown_connections 2023-03-06T14:16:09.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.921+0000 7f3505bbc700 1 -- 172.21.15.3:0/3152613517 wait complete. 2023-03-06T14:16:09.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.922+0000 7f3505bbc700 1 Processor -- start 2023-03-06T14:16:09.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.922+0000 7f3505bbc700 1 -- start start 2023-03-06T14:16:09.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f3505bbc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35000b8140 0x7f35000bad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:09.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f3505bbc700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35000b9070 0x7f35000b9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:09.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f3505bbc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3500146130 0x7f35000b9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:09.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f3505bbc700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35000bbe00 con 0x7f35000b8140 2023-03-06T14:16:09.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f3505bbc700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35000bb260 con 0x7f3500146130 2023-03-06T14:16:09.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f3505bbc700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3500142bf0 con 0x7f35000b9070 2023-03-06T14:16:09.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f34ff7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35000b8140 0x7f35000bad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:09.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f34ff7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35000b8140 0x7f35000bad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55748/0 (socket says 172.21.15.3:55748) 2023-03-06T14:16:09.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f34ff7fe700 1 -- 172.21.15.3:0/529957253 learned_addr learned my addr 172.21.15.3:0/529957253 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:09.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f34fffff700 1 --2- 172.21.15.3:0/529957253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3500146130 0x7f35000b9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:09.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f34feffd700 1 --2- 172.21.15.3:0/529957253 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35000b9070 0x7f35000b9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:09.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f34ff7fe700 1 -- 172.21.15.3:0/529957253 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35000b9070 msgr2=0x7f35000b9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:09.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f34ff7fe700 1 --2- 172.21.15.3:0/529957253 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35000b9070 0x7f35000b9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f34ff7fe700 1 -- 172.21.15.3:0/529957253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3500146130 msgr2=0x7f35000b9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:09.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f34ff7fe700 1 --2- 172.21.15.3:0/529957253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3500146130 0x7f35000b9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:09.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f34ff7fe700 1 -- 172.21.15.3:0/529957253 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f0009430 con 0x7f35000b8140 2023-03-06T14:16:09.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f34fffff700 1 --2- 172.21.15.3:0/529957253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3500146130 0x7f35000b9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:09.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f34ff7fe700 1 --2- 172.21.15.3:0/529957253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35000b8140 0x7f35000bad20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f34f0000c00 tx=0x7f34f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:09.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f34f7fff700 1 -- 172.21.15.3:0/529957253 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f001f070 con 0x7f35000b8140 2023-03-06T14:16:09.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f34f7fff700 1 -- 172.21.15.3:0/529957253 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f0018420 con 0x7f35000b8140 2023-03-06T14:16:09.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f3505bbc700 1 -- 172.21.15.3:0/529957253 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35000b8870 con 0x7f35000b8140 2023-03-06T14:16:09.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f34f7fff700 1 -- 172.21.15.3:0/529957253 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f00187d0 con 0x7f35000b8140 2023-03-06T14:16:09.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.923+0000 7f3505bbc700 1 -- 172.21.15.3:0/529957253 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350006f9a0 con 0x7f35000b8140 2023-03-06T14:16:09.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.924+0000 7f3505bbc700 1 -- 172.21.15.3:0/529957253 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35000b8b50 con 0x7f35000b8140 2023-03-06T14:16:09.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.925+0000 7f34f7fff700 1 -- 172.21.15.3:0/529957253 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f34f002a030 con 0x7f35000b8140 2023-03-06T14:16:09.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.925+0000 7f34f7fff700 1 --2- 172.21.15.3:0/529957253 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f34e00682f0 0x7f34e006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:09.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.925+0000 7f34f7fff700 1 -- 172.21.15.3:0/529957253 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f34f0088460 con 0x7f35000b8140 2023-03-06T14:16:09.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.925+0000 7f34feffd700 1 --2- 172.21.15.3:0/529957253 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f34e00682f0 0x7f34e006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:09.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.926+0000 7f34feffd700 1 --2- 172.21.15.3:0/529957253 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f34e00682f0 0x7f34e006a7a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f350014aad0 tx=0x7f34e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:09.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:09.930+0000 7f34f7fff700 1 -- 172.21.15.3:0/529957253 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f34f00548e0 con 0x7f35000b8140 2023-03-06T14:16:10.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.126+0000 7f3505bbc700 1 -- 172.21.15.3:0/529957253 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f35000b9560 con 0x7f35000b8140 2023-03-06T14:16:10.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.127+0000 7f34f7fff700 1 -- 172.21.15.3:0/529957253 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f34f0028020 con 0x7f35000b8140 2023-03-06T14:16:10.129 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-03-06T14:16:10.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.129+0000 7f3505bbc700 1 -- 172.21.15.3:0/529957253 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f34e00682f0 msgr2=0x7f34e006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:10.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.129+0000 7f3505bbc700 1 --2- 172.21.15.3:0/529957253 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f34e00682f0 0x7f34e006a7a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f350014aad0 tx=0x7f34e8009040 comp rx=0 tx=0).stop 2023-03-06T14:16:10.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.129+0000 7f3505bbc700 1 -- 172.21.15.3:0/529957253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35000b8140 msgr2=0x7f35000bad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:10.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.129+0000 7f3505bbc700 1 --2- 172.21.15.3:0/529957253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35000b8140 0x7f35000bad20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f34f0000c00 tx=0x7f34f0004750 comp rx=0 tx=0).stop 2023-03-06T14:16:10.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.129+0000 7f3505bbc700 1 -- 172.21.15.3:0/529957253 shutdown_connections 2023-03-06T14:16:10.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.129+0000 7f3505bbc700 1 --2- 172.21.15.3:0/529957253 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f34e00682f0 0x7f34e006a7a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.129+0000 7f3505bbc700 1 --2- 172.21.15.3:0/529957253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35000b8140 0x7f35000bad20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.129+0000 7f3505bbc700 1 --2- 172.21.15.3:0/529957253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3500146130 0x7f35000b9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.129+0000 7f3505bbc700 1 --2- 172.21.15.3:0/529957253 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35000b9070 0x7f35000b9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.129+0000 7f3505bbc700 1 -- 172.21.15.3:0/529957253 >> 172.21.15.3:0/529957253 conn(0x7f35000c2150 msgr2=0x7f35000b7750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:10.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.129+0000 7f3505bbc700 1 -- 172.21.15.3:0/529957253 shutdown_connections 2023-03-06T14:16:10.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.129+0000 7f3505bbc700 1 -- 172.21.15.3:0/529957253 wait complete. 2023-03-06T14:16:10.142 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-06T14:16:10.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.268+0000 7f8de3d3a700 1 Processor -- start 2023-03-06T14:16:10.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.268+0000 7f8de3d3a700 1 -- start start 2023-03-06T14:16:10.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.269+0000 7f8de3d3a700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8ddc0b7110 0x7f8ddc0bd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:10.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.269+0000 7f8de3d3a700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ddc14f1a0 con 0x7f8ddc06ee40 2023-03-06T14:16:10.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.269+0000 7f8de3d3a700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ddc06fc00 con 0x7f8ddc06ea70 2023-03-06T14:16:10.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.269+0000 7f8de3d3a700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ddc0a8140 con 0x7f8ddc0b7110 2023-03-06T14:16:10.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.269+0000 7f8de22d7700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8ddc0b7110 0x7f8ddc0bd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:10.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.269+0000 7f8de12d5700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f8ddc06ee40 0x7f8ddc157b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58030/0 (socket says 172.21.15.3:58030) 2023-03-06T14:16:10.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.269+0000 7f8de12d5700 1 -- 172.21.15.3:0/1254648429 learned_addr learned my addr 172.21.15.3:0/1254648429 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:10.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.269+0000 7f8de22d7700 1 -- 172.21.15.3:0/1254648429 >> v1:172.21.15.136:6789/0 conn(0x7f8ddc06ea70 legacy=0x7f8ddc148e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:10.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.269+0000 7f8de22d7700 1 -- 172.21.15.3:0/1254648429 >> v1:172.21.15.3:6789/0 conn(0x7f8ddc06ee40 legacy=0x7f8ddc157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:10.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.269+0000 7f8de22d7700 1 -- 172.21.15.3:0/1254648429 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc0bcb00 con 0x7f8ddc0b7110 2023-03-06T14:16:10.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.269+0000 7f8de0ad4700 1 -- 172.21.15.3:0/1254648429 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19809978 0 0) 0x7f8ddc14f1a0 con 0x7f8ddc06ee40 2023-03-06T14:16:10.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.270+0000 7f8de22d7700 1 --2- 172.21.15.3:0/1254648429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ddc0b7110 0x7f8ddc0bd8c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009d90 tx=0x7f8dd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff5571dc881f84b server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:10.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.270+0000 7f8de0ad4700 1 -- 172.21.15.3:0/1254648429 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd400e070 con 0x7f8ddc0b7110 2023-03-06T14:16:10.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.270+0000 7f8de0ad4700 1 -- 172.21.15.3:0/1254648429 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd400bbd0 con 0x7f8ddc0b7110 2023-03-06T14:16:10.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.270+0000 7f8de0ad4700 1 -- 172.21.15.3:0/1254648429 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4012430 con 0x7f8ddc0b7110 2023-03-06T14:16:10.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.270+0000 7f8de3d3a700 1 -- 172.21.15.3:0/1254648429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ddc0b7110 msgr2=0x7f8ddc0bd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:10.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.270+0000 7f8de3d3a700 1 --2- 172.21.15.3:0/1254648429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ddc0b7110 0x7f8ddc0bd8c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009d90 tx=0x7f8dd400b330 comp rx=0 tx=0).stop 2023-03-06T14:16:10.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.270+0000 7f8de3d3a700 1 -- 172.21.15.3:0/1254648429 shutdown_connections 2023-03-06T14:16:10.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.270+0000 7f8de3d3a700 1 --2- 172.21.15.3:0/1254648429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ddc0b7110 0x7f8ddc0bd8c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.270+0000 7f8de3d3a700 1 -- 172.21.15.3:0/1254648429 >> 172.21.15.3:0/1254648429 conn(0x7f8ddc0c2060 msgr2=0x7f8ddc0c2430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:10.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.270+0000 7f8de3d3a700 1 -- 172.21.15.3:0/1254648429 shutdown_connections 2023-03-06T14:16:10.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.270+0000 7f8de3d3a700 1 -- 172.21.15.3:0/1254648429 wait complete. 2023-03-06T14:16:10.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.271+0000 7f8de3d3a700 1 Processor -- start 2023-03-06T14:16:10.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.272+0000 7f8de3d3a700 1 -- start start 2023-03-06T14:16:10.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.272+0000 7f8de3d3a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ddc06ea70 0x7f8ddc1d8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:10.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.272+0000 7f8de3d3a700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ddc06ee40 0x7f8ddc14ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:10.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.272+0000 7f8de3d3a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ddc0b7110 0x7f8ddc0a6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:10.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.272+0000 7f8de3d3a700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc14ed00 con 0x7f8ddc0b7110 2023-03-06T14:16:10.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.272+0000 7f8de3d3a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc1da6a0 con 0x7f8ddc06ea70 2023-03-06T14:16:10.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.272+0000 7f8de3d3a700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc14d920 con 0x7f8ddc06ee40 2023-03-06T14:16:10.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.272+0000 7f8de22d7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ddc0b7110 0x7f8ddc0a6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:10.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.272+0000 7f8de22d7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ddc0b7110 0x7f8ddc0a6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55766/0 (socket says 172.21.15.3:55766) 2023-03-06T14:16:10.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.272+0000 7f8de22d7700 1 -- 172.21.15.3:0/1889751364 learned_addr learned my addr 172.21.15.3:0/1889751364 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:10.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.272+0000 7f8de12d5700 1 --2- 172.21.15.3:0/1889751364 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ddc06ee40 0x7f8ddc14ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:10.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.272+0000 7f8de1ad6700 1 --2- 172.21.15.3:0/1889751364 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ddc06ea70 0x7f8ddc1d8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:10.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.273+0000 7f8de22d7700 1 -- 172.21.15.3:0/1889751364 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ddc06ee40 msgr2=0x7f8ddc14ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:10.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.273+0000 7f8de22d7700 1 --2- 172.21.15.3:0/1889751364 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ddc06ee40 0x7f8ddc14ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.273+0000 7f8de22d7700 1 -- 172.21.15.3:0/1889751364 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ddc06ea70 msgr2=0x7f8ddc1d8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:10.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.273+0000 7f8de22d7700 1 --2- 172.21.15.3:0/1889751364 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ddc06ea70 0x7f8ddc1d8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.273+0000 7f8de22d7700 1 -- 172.21.15.3:0/1889751364 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd4009a70 con 0x7f8ddc0b7110 2023-03-06T14:16:10.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.273+0000 7f8de22d7700 1 --2- 172.21.15.3:0/1889751364 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ddc0b7110 0x7f8ddc0a6740 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4014040 tx=0x7f8dd4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:10.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.273+0000 7f8dd27fc700 1 -- 172.21.15.3:0/1889751364 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd401b810 con 0x7f8ddc0b7110 2023-03-06T14:16:10.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.273+0000 7f8dd27fc700 1 -- 172.21.15.3:0/1889751364 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd4020070 con 0x7f8ddc0b7110 2023-03-06T14:16:10.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.273+0000 7f8de3d3a700 1 -- 172.21.15.3:0/1889751364 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ddc0bd0c0 con 0x7f8ddc0b7110 2023-03-06T14:16:10.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.273+0000 7f8dd27fc700 1 -- 172.21.15.3:0/1889751364 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd401bbd0 con 0x7f8ddc0b7110 2023-03-06T14:16:10.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.273+0000 7f8de3d3a700 1 -- 172.21.15.3:0/1889751364 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ddc0bcde0 con 0x7f8ddc0b7110 2023-03-06T14:16:10.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.274+0000 7f8de3d3a700 1 -- 172.21.15.3:0/1889751364 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ddc0bd3a0 con 0x7f8ddc0b7110 2023-03-06T14:16:10.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.274+0000 7f8dd27fc700 1 -- 172.21.15.3:0/1889751364 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8dd401bd30 con 0x7f8ddc0b7110 2023-03-06T14:16:10.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.275+0000 7f8dd27fc700 1 --2- 172.21.15.3:0/1889751364 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f8dc00682f0 0x7f8dc006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:10.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.275+0000 7f8dd27fc700 1 -- 172.21.15.3:0/1889751364 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8dd4022070 con 0x7f8ddc0b7110 2023-03-06T14:16:10.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.275+0000 7f8de1ad6700 1 --2- 172.21.15.3:0/1889751364 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f8dc00682f0 0x7f8dc006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:10.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.275+0000 7f8de1ad6700 1 --2- 172.21.15.3:0/1889751364 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f8dc00682f0 0x7f8dc006a7a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc007fd0 tx=0x7f8dcc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:10.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.279+0000 7f8dd27fc700 1 -- 172.21.15.3:0/1889751364 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8dd4054bb0 con 0x7f8ddc0b7110 2023-03-06T14:16:10.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.474+0000 7f8de3d3a700 1 -- 172.21.15.3:0/1889751364 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ddc067670 con 0x7f8ddc0b7110 2023-03-06T14:16:10.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.474+0000 7f8dd27fc700 1 -- 172.21.15.3:0/1889751364 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8dd40581d0 con 0x7f8ddc0b7110 2023-03-06T14:16:10.476 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-03-06T14:16:10.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.476+0000 7f8de3d3a700 1 -- 172.21.15.3:0/1889751364 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f8dc00682f0 msgr2=0x7f8dc006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:10.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.476+0000 7f8de3d3a700 1 --2- 172.21.15.3:0/1889751364 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f8dc00682f0 0x7f8dc006a7a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc007fd0 tx=0x7f8dcc009040 comp rx=0 tx=0).stop 2023-03-06T14:16:10.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.476+0000 7f8de3d3a700 1 -- 172.21.15.3:0/1889751364 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ddc0b7110 msgr2=0x7f8ddc0a6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:10.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.476+0000 7f8de3d3a700 1 --2- 172.21.15.3:0/1889751364 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ddc0b7110 0x7f8ddc0a6740 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4014040 tx=0x7f8dd4004ad0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.476+0000 7f8de3d3a700 1 -- 172.21.15.3:0/1889751364 shutdown_connections 2023-03-06T14:16:10.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.476+0000 7f8de3d3a700 1 --2- 172.21.15.3:0/1889751364 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f8dc00682f0 0x7f8dc006a7a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.476+0000 7f8de3d3a700 1 --2- 172.21.15.3:0/1889751364 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ddc0b7110 0x7f8ddc0a6740 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.476+0000 7f8de3d3a700 1 --2- 172.21.15.3:0/1889751364 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ddc06ea70 0x7f8ddc1d8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.476+0000 7f8de3d3a700 1 --2- 172.21.15.3:0/1889751364 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ddc06ee40 0x7f8ddc14ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.476+0000 7f8de3d3a700 1 -- 172.21.15.3:0/1889751364 >> 172.21.15.3:0/1889751364 conn(0x7f8ddc0c2060 msgr2=0x7f8ddc0c17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.476+0000 7f8de3d3a700 1 -- 172.21.15.3:0/1889751364 shutdown_connections 2023-03-06T14:16:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.476+0000 7f8de3d3a700 1 -- 172.21.15.3:0/1889751364 wait complete. 2023-03-06T14:16:10.489 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-06T14:16:10.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.615+0000 7f15370c0700 1 Processor -- start 2023-03-06T14:16:10.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.615+0000 7f15370c0700 1 -- start start 2023-03-06T14:16:10.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.616+0000 7f15370c0700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15300c1fe0 0x7f15300c0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:10.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.616+0000 7f15370c0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f153006fde0 0x7f15300beb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:10.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.616+0000 7f15370c0700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1530070670 con 0x7f15300bf040 2023-03-06T14:16:10.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.616+0000 7f15370c0700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15300c23b0 con 0x7f153006fde0 2023-03-06T14:16:10.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.616+0000 7f15370c0700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1530151070 con 0x7f15300c1fe0 2023-03-06T14:16:10.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.616+0000 7f152ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f153006fde0 0x7f15300beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:10.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.616+0000 7f152ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f153006fde0 0x7f15300beb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55772/0 (socket says 172.21.15.3:55772) 2023-03-06T14:16:10.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.616+0000 7f152ffff700 1 -- 172.21.15.3:0/3742107462 learned_addr learned my addr 172.21.15.3:0/3742107462 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:10.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.616+0000 7f1534e5c700 1 --2- 172.21.15.3:0/3742107462 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15300c1fe0 0x7f15300c0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:10.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.616+0000 7f152ffff700 1 -- 172.21.15.3:0/3742107462 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15300c1fe0 msgr2=0x7f15300c0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:10.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.616+0000 7f152ffff700 1 --2- 172.21.15.3:0/3742107462 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15300c1fe0 0x7f15300c0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.616+0000 7f152ffff700 1 -- 172.21.15.3:0/3742107462 >> v1:172.21.15.136:6789/0 conn(0x7f15300bf040 legacy=0x7f1530146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:10.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.616+0000 7f152ffff700 1 -- 172.21.15.3:0/3742107462 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1530151350 con 0x7f153006fde0 2023-03-06T14:16:10.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.616+0000 7f1534e5c700 1 --2- 172.21.15.3:0/3742107462 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15300c1fe0 0x7f15300c0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:16:10.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.617+0000 7f152ffff700 1 --2- 172.21.15.3:0/3742107462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f153006fde0 0x7f15300beb00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f151c0098f0 tx=0x7f151c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3cd83018396737 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:10.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.617+0000 7f152f7fe700 1 -- 172.21.15.3:0/3742107462 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c004230 con 0x7f153006fde0 2023-03-06T14:16:10.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.617+0000 7f152f7fe700 1 -- 172.21.15.3:0/3742107462 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c004390 con 0x7f153006fde0 2023-03-06T14:16:10.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.617+0000 7f152f7fe700 1 -- 172.21.15.3:0/3742107462 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c0036a0 con 0x7f153006fde0 2023-03-06T14:16:10.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.617+0000 7f15370c0700 1 -- 172.21.15.3:0/3742107462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f153006fde0 msgr2=0x7f15300beb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:10.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.617+0000 7f15370c0700 1 --2- 172.21.15.3:0/3742107462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f153006fde0 0x7f15300beb00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f151c0098f0 tx=0x7f151c009c00 comp rx=0 tx=0).stop 2023-03-06T14:16:10.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.617+0000 7f15370c0700 1 -- 172.21.15.3:0/3742107462 shutdown_connections 2023-03-06T14:16:10.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.617+0000 7f15370c0700 1 --2- 172.21.15.3:0/3742107462 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15300c1fe0 0x7f15300c0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.617+0000 7f15370c0700 1 --2- 172.21.15.3:0/3742107462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f153006fde0 0x7f15300beb00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.617+0000 7f15370c0700 1 -- 172.21.15.3:0/3742107462 >> 172.21.15.3:0/3742107462 conn(0x7f15300c31d0 msgr2=0x7f15300c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:10.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.617+0000 7f15370c0700 1 -- 172.21.15.3:0/3742107462 shutdown_connections 2023-03-06T14:16:10.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.617+0000 7f15370c0700 1 -- 172.21.15.3:0/3742107462 wait complete. 2023-03-06T14:16:10.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.618+0000 7f15370c0700 1 Processor -- start 2023-03-06T14:16:10.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.619+0000 7f15370c0700 1 -- start start 2023-03-06T14:16:10.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.619+0000 7f15370c0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f153006fde0 0x7f15301e5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:10.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.619+0000 7f15370c0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15300bf040 0x7f15301e87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:10.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.619+0000 7f15370c0700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15300c1fe0 0x7f153006cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:10.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.619+0000 7f15370c0700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15301e57d0 con 0x7f153006fde0 2023-03-06T14:16:10.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.619+0000 7f15370c0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15301e8d10 con 0x7f15300bf040 2023-03-06T14:16:10.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.619+0000 7f15370c0700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15300b8710 con 0x7f15300c1fe0 2023-03-06T14:16:10.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.619+0000 7f1534e5c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f153006fde0 0x7f15301e5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:10.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.619+0000 7f1534e5c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f153006fde0 0x7f15301e5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55776/0 (socket says 172.21.15.3:55776) 2023-03-06T14:16:10.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.619+0000 7f1534e5c700 1 -- 172.21.15.3:0/2531600243 learned_addr learned my addr 172.21.15.3:0/2531600243 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:10.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.620+0000 7f153565d700 1 --2- 172.21.15.3:0/2531600243 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15300c1fe0 0x7f153006cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:10.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.620+0000 7f1534e5c700 1 -- 172.21.15.3:0/2531600243 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15300c1fe0 msgr2=0x7f153006cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:10.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.620+0000 7f1534e5c700 1 --2- 172.21.15.3:0/2531600243 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15300c1fe0 0x7f153006cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.620+0000 7f1534e5c700 1 -- 172.21.15.3:0/2531600243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15300bf040 msgr2=0x7f15301e87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:10.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.620+0000 7f1534e5c700 1 --2- 172.21.15.3:0/2531600243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15300bf040 0x7f15301e87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.620+0000 7f1534e5c700 1 -- 172.21.15.3:0/2531600243 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c009550 con 0x7f153006fde0 2023-03-06T14:16:10.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.620+0000 7f1534e5c700 1 --2- 172.21.15.3:0/2531600243 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f153006fde0 0x7f15301e5290 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f152400c750 tx=0x7f152400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:10.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.620+0000 7f152d7fa700 1 -- 172.21.15.3:0/2531600243 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524011800 con 0x7f153006fde0 2023-03-06T14:16:10.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.620+0000 7f152d7fa700 1 -- 172.21.15.3:0/2531600243 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1524011960 con 0x7f153006fde0 2023-03-06T14:16:10.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.620+0000 7f15370c0700 1 -- 172.21.15.3:0/2531600243 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15300bf9f0 con 0x7f153006fde0 2023-03-06T14:16:10.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.620+0000 7f152d7fa700 1 -- 172.21.15.3:0/2531600243 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524011cd0 con 0x7f153006fde0 2023-03-06T14:16:10.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.620+0000 7f15370c0700 1 -- 172.21.15.3:0/2531600243 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15300c2600 con 0x7f153006fde0 2023-03-06T14:16:10.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.621+0000 7f15370c0700 1 -- 172.21.15.3:0/2531600243 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15300c2b20 con 0x7f153006fde0 2023-03-06T14:16:10.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.621+0000 7f152d7fa700 1 -- 172.21.15.3:0/2531600243 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1524020070 con 0x7f153006fde0 2023-03-06T14:16:10.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.622+0000 7f152d7fa700 1 --2- 172.21.15.3:0/2531600243 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f15140682f0 0x7f151406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:10.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.622+0000 7f152d7fa700 1 -- 172.21.15.3:0/2531600243 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1524085e00 con 0x7f153006fde0 2023-03-06T14:16:10.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.622+0000 7f152ffff700 1 --2- 172.21.15.3:0/2531600243 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f15140682f0 0x7f151406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:10.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.623+0000 7f152ffff700 1 --2- 172.21.15.3:0/2531600243 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f15140682f0 0x7f151406a7a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f15300b8e50 tx=0x7f151c010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:10.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.626+0000 7f152d7fa700 1 -- 172.21.15.3:0/2531600243 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1524052370 con 0x7f153006fde0 2023-03-06T14:16:10.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.822+0000 7f15370c0700 1 -- 172.21.15.3:0/2531600243 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1530070a50 con 0x7f153006fde0 2023-03-06T14:16:10.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.822+0000 7f152d7fa700 1 -- 172.21.15.3:0/2531600243 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1524055990 con 0x7f153006fde0 2023-03-06T14:16:10.824 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-03-06T14:16:10.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.824+0000 7f15370c0700 1 -- 172.21.15.3:0/2531600243 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f15140682f0 msgr2=0x7f151406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:10.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.824+0000 7f15370c0700 1 --2- 172.21.15.3:0/2531600243 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f15140682f0 0x7f151406a7a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f15300b8e50 tx=0x7f151c010000 comp rx=0 tx=0).stop 2023-03-06T14:16:10.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.824+0000 7f15370c0700 1 -- 172.21.15.3:0/2531600243 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f153006fde0 msgr2=0x7f15301e5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:10.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.824+0000 7f15370c0700 1 --2- 172.21.15.3:0/2531600243 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f153006fde0 0x7f15301e5290 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f152400c750 tx=0x7f152400cb10 comp rx=0 tx=0).stop 2023-03-06T14:16:10.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.824+0000 7f15370c0700 1 -- 172.21.15.3:0/2531600243 shutdown_connections 2023-03-06T14:16:10.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.824+0000 7f15370c0700 1 --2- 172.21.15.3:0/2531600243 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f15140682f0 0x7f151406a7a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.824+0000 7f15370c0700 1 --2- 172.21.15.3:0/2531600243 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f153006fde0 0x7f15301e5290 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.824+0000 7f15370c0700 1 --2- 172.21.15.3:0/2531600243 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15300c1fe0 0x7f153006cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.824+0000 7f15370c0700 1 --2- 172.21.15.3:0/2531600243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15300bf040 0x7f15301e87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.824+0000 7f15370c0700 1 -- 172.21.15.3:0/2531600243 >> 172.21.15.3:0/2531600243 conn(0x7f15300c31d0 msgr2=0x7f153006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:10.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.825+0000 7f15370c0700 1 -- 172.21.15.3:0/2531600243 shutdown_connections 2023-03-06T14:16:10.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.825+0000 7f15370c0700 1 -- 172.21.15.3:0/2531600243 wait complete. 2023-03-06T14:16:10.838 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-06T14:16:10.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.964+0000 7f0e1c839700 1 Processor -- start 2023-03-06T14:16:10.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.964+0000 7f0e1c839700 1 -- start start 2023-03-06T14:16:10.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.964+0000 7f0e1c839700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e180b77d0 0x7f0e1814fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:10.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.965+0000 7f0e1c839700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0e180b7ba0 0x7f0e18152f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:10.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.965+0000 7f0e1c839700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e18152aa0 con 0x7f0e18148c10 2023-03-06T14:16:10.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.965+0000 7f0e1c839700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e1814ffd0 con 0x7f0e180b7ba0 2023-03-06T14:16:10.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.965+0000 7f0e1c839700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1806f720 con 0x7f0e180b77d0 2023-03-06T14:16:10.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.965+0000 7f0e15d9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0e180b7ba0 0x7f0e18152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:10.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.965+0000 7f0e16d9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f0e18148c10 0x7f0e1806def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58060/0 (socket says 172.21.15.3:58060) 2023-03-06T14:16:10.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.965+0000 7f0e16d9d700 1 -- 172.21.15.3:0/1875278570 learned_addr learned my addr 172.21.15.3:0/1875278570 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:10.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.965+0000 7f0e15d9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0e180b7ba0 0x7f0e18152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55786/0 (socket says 172.21.15.3:55786) 2023-03-06T14:16:10.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.965+0000 7f0e1659c700 1 --2- 172.21.15.3:0/1875278570 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e180b77d0 0x7f0e1814fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:10.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.965+0000 7f0e15d9b700 1 -- 172.21.15.3:0/1875278570 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e180b77d0 msgr2=0x7f0e1814fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:10.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.965+0000 7f0e15d9b700 1 --2- 172.21.15.3:0/1875278570 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e180b77d0 0x7f0e1814fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.965+0000 7f0e15d9b700 1 -- 172.21.15.3:0/1875278570 >> v1:172.21.15.3:6789/0 conn(0x7f0e18148c10 legacy=0x7f0e1806def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:10.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.965+0000 7f0e1559a700 1 -- 172.21.15.3:0/1875278570 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700621434 0 0) 0x7f0e18152aa0 con 0x7f0e18148c10 2023-03-06T14:16:10.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.965+0000 7f0e15d9b700 1 -- 172.21.15.3:0/1875278570 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1806f160 con 0x7f0e180b7ba0 2023-03-06T14:16:10.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.965+0000 7f0e15d9b700 1 --2- 172.21.15.3:0/1875278570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e180b7ba0 0x7f0e18152f30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009840 tx=0x7f0e0c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902d690f69e5ac6a server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:10.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.965+0000 7f0e1559a700 1 -- 172.21.15.3:0/1875278570 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c011830 con 0x7f0e180b7ba0 2023-03-06T14:16:10.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.965+0000 7f0e1559a700 1 -- 172.21.15.3:0/1875278570 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c011990 con 0x7f0e180b7ba0 2023-03-06T14:16:10.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.965+0000 7f0e1559a700 1 -- 172.21.15.3:0/1875278570 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c011d20 con 0x7f0e180b7ba0 2023-03-06T14:16:10.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.966+0000 7f0e1c839700 1 -- 172.21.15.3:0/1875278570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e180b7ba0 msgr2=0x7f0e18152f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:10.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.966+0000 7f0e1c839700 1 --2- 172.21.15.3:0/1875278570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e180b7ba0 0x7f0e18152f30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009840 tx=0x7f0e0c009b50 comp rx=0 tx=0).stop 2023-03-06T14:16:10.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.966+0000 7f0e1c839700 1 -- 172.21.15.3:0/1875278570 shutdown_connections 2023-03-06T14:16:10.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.966+0000 7f0e1c839700 1 --2- 172.21.15.3:0/1875278570 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e180b77d0 0x7f0e1814fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.966+0000 7f0e1c839700 1 --2- 172.21.15.3:0/1875278570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e180b7ba0 0x7f0e18152f30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.966+0000 7f0e1c839700 1 -- 172.21.15.3:0/1875278570 >> 172.21.15.3:0/1875278570 conn(0x7f0e180c17d0 msgr2=0x7f0e180c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:10.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.966+0000 7f0e1c839700 1 -- 172.21.15.3:0/1875278570 shutdown_connections 2023-03-06T14:16:10.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.966+0000 7f0e1c839700 1 -- 172.21.15.3:0/1875278570 wait complete. 2023-03-06T14:16:10.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.967+0000 7f0e1c839700 1 Processor -- start 2023-03-06T14:16:10.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.967+0000 7f0e1c839700 1 -- start start 2023-03-06T14:16:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.968+0000 7f0e1c839700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e180b77d0 0x7f0e1814a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.968+0000 7f0e1c839700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e180b7ba0 0x7f0e18146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.968+0000 7f0e1c839700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e18148c10 0x7f0e180a68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.968+0000 7f0e1c839700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e18147510 con 0x7f0e180b7ba0 2023-03-06T14:16:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.968+0000 7f0e1c839700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1814e650 con 0x7f0e180b77d0 2023-03-06T14:16:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.968+0000 7f0e1c839700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1814c1f0 con 0x7f0e18148c10 2023-03-06T14:16:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.968+0000 7f0e15d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e180b7ba0 0x7f0e18146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:10.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.968+0000 7f0e15d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e180b7ba0 0x7f0e18146fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55792/0 (socket says 172.21.15.3:55792) 2023-03-06T14:16:10.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.968+0000 7f0e15d9b700 1 -- 172.21.15.3:0/3915883198 learned_addr learned my addr 172.21.15.3:0/3915883198 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:10.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.968+0000 7f0e16d9d700 1 --2- 172.21.15.3:0/3915883198 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e18148c10 0x7f0e180a68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:10.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.968+0000 7f0e1659c700 1 --2- 172.21.15.3:0/3915883198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e180b77d0 0x7f0e1814a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:10.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.968+0000 7f0e15d9b700 1 -- 172.21.15.3:0/3915883198 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e18148c10 msgr2=0x7f0e180a68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:10.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.968+0000 7f0e15d9b700 1 --2- 172.21.15.3:0/3915883198 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e18148c10 0x7f0e180a68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.968+0000 7f0e15d9b700 1 -- 172.21.15.3:0/3915883198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e180b77d0 msgr2=0x7f0e1814a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:10.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.968+0000 7f0e15d9b700 1 --2- 172.21.15.3:0/3915883198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e180b77d0 0x7f0e1814a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:10.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.968+0000 7f0e15d9b700 1 -- 172.21.15.3:0/3915883198 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c0094a0 con 0x7f0e180b7ba0 2023-03-06T14:16:10.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.968+0000 7f0e1659c700 1 --2- 172.21.15.3:0/3915883198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e180b77d0 0x7f0e1814a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:10.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.969+0000 7f0e15d9b700 1 --2- 172.21.15.3:0/3915883198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e180b7ba0 0x7f0e18146fd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0090b0 tx=0x7f0e0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:10.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.969+0000 7f0e06ffd700 1 -- 172.21.15.3:0/3915883198 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0045d0 con 0x7f0e180b7ba0 2023-03-06T14:16:10.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.969+0000 7f0e06ffd700 1 -- 172.21.15.3:0/3915883198 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c01f070 con 0x7f0e180b7ba0 2023-03-06T14:16:10.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.969+0000 7f0e1c839700 1 -- 172.21.15.3:0/3915883198 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e18152730 con 0x7f0e180b7ba0 2023-03-06T14:16:10.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.969+0000 7f0e06ffd700 1 -- 172.21.15.3:0/3915883198 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0038e0 con 0x7f0e180b7ba0 2023-03-06T14:16:10.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.969+0000 7f0e1c839700 1 -- 172.21.15.3:0/3915883198 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1806f440 con 0x7f0e180b7ba0 2023-03-06T14:16:10.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.970+0000 7f0e1c839700 1 -- 172.21.15.3:0/3915883198 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e18153470 con 0x7f0e180b7ba0 2023-03-06T14:16:10.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.970+0000 7f0e06ffd700 1 -- 172.21.15.3:0/3915883198 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0e0c00f050 con 0x7f0e180b7ba0 2023-03-06T14:16:10.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.970+0000 7f0e06ffd700 1 --2- 172.21.15.3:0/3915883198 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0df80682f0 0x7f0df806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:10.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.971+0000 7f0e06ffd700 1 -- 172.21.15.3:0/3915883198 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0e0c021070 con 0x7f0e180b7ba0 2023-03-06T14:16:10.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.971+0000 7f0e1659c700 1 --2- 172.21.15.3:0/3915883198 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0df80682f0 0x7f0df806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:10.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.971+0000 7f0e1659c700 1 --2- 172.21.15.3:0/3915883198 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0df80682f0 0x7f0df806a7a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009b90 tx=0x7f0e08008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:10.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:10.975+0000 7f0e06ffd700 1 -- 172.21.15.3:0/3915883198 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0e0c053d80 con 0x7f0e180b7ba0 2023-03-06T14:16:11.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.164+0000 7f0e1c839700 1 -- 172.21.15.3:0/3915883198 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0e1814a310 con 0x7f0e180b7ba0 2023-03-06T14:16:11.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.165+0000 7f0e06ffd700 1 -- 172.21.15.3:0/3915883198 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0e0c0573a0 con 0x7f0e180b7ba0 2023-03-06T14:16:11.166 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-03-06T14:16:11.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.167+0000 7f0e1c839700 1 -- 172.21.15.3:0/3915883198 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0df80682f0 msgr2=0x7f0df806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:11.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.167+0000 7f0e1c839700 1 --2- 172.21.15.3:0/3915883198 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0df80682f0 0x7f0df806a7a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009b90 tx=0x7f0e08008040 comp rx=0 tx=0).stop 2023-03-06T14:16:11.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.167+0000 7f0e1c839700 1 -- 172.21.15.3:0/3915883198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e180b7ba0 msgr2=0x7f0e18146fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:11.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.167+0000 7f0e1c839700 1 --2- 172.21.15.3:0/3915883198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e180b7ba0 0x7f0e18146fd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0090b0 tx=0x7f0e0c004750 comp rx=0 tx=0).stop 2023-03-06T14:16:11.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.167+0000 7f0e1c839700 1 -- 172.21.15.3:0/3915883198 shutdown_connections 2023-03-06T14:16:11.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.167+0000 7f0e1c839700 1 --2- 172.21.15.3:0/3915883198 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0df80682f0 0x7f0df806a7a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.167+0000 7f0e1c839700 1 --2- 172.21.15.3:0/3915883198 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e18148c10 0x7f0e180a68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.167+0000 7f0e1c839700 1 --2- 172.21.15.3:0/3915883198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e180b77d0 0x7f0e1814a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.167+0000 7f0e1c839700 1 --2- 172.21.15.3:0/3915883198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e180b7ba0 0x7f0e18146fd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.167+0000 7f0e1c839700 1 -- 172.21.15.3:0/3915883198 >> 172.21.15.3:0/3915883198 conn(0x7f0e180c17d0 msgr2=0x7f0e18147f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:11.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.167+0000 7f0e1c839700 1 -- 172.21.15.3:0/3915883198 shutdown_connections 2023-03-06T14:16:11.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.167+0000 7f0e1c839700 1 -- 172.21.15.3:0/3915883198 wait complete. 2023-03-06T14:16:11.180 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-06T14:16:11.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.304+0000 7f200d033700 1 Processor -- start 2023-03-06T14:16:11.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.304+0000 7f200d033700 1 -- start start 2023-03-06T14:16:11.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.305+0000 7f200d033700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f200806ea70 0x7f20080bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:11.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.305+0000 7f200d033700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f200806ee40 0x7f20081490f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:11.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.305+0000 7f200d033700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f200814ff80 con 0x7f20080bdd60 2023-03-06T14:16:11.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.305+0000 7f200d033700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20080b9070 con 0x7f200806ea70 2023-03-06T14:16:11.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.305+0000 7f200d033700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20080bcb90 con 0x7f200806ee40 2023-03-06T14:16:11.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.305+0000 7f2006d9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f200806ea70 0x7f20080bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:11.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.305+0000 7f2006d9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f200806ea70 0x7f20080bd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55798/0 (socket says 172.21.15.3:55798) 2023-03-06T14:16:11.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.305+0000 7f2006d9d700 1 -- 172.21.15.3:0/3219722380 learned_addr learned my addr 172.21.15.3:0/3219722380 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:11.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.305+0000 7f200659c700 1 --2- 172.21.15.3:0/3219722380 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f200806ee40 0x7f20081490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:11.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.305+0000 7f2006d9d700 1 -- 172.21.15.3:0/3219722380 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f200806ee40 msgr2=0x7f20081490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:11.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.305+0000 7f2006d9d700 1 --2- 172.21.15.3:0/3219722380 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f200806ee40 0x7f20081490f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.305+0000 7f2006d9d700 1 -- 172.21.15.3:0/3219722380 >> v1:172.21.15.136:6789/0 conn(0x7f20080bdd60 legacy=0x7f200806c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:11.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.305+0000 7f2006d9d700 1 -- 172.21.15.3:0/3219722380 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20080bce70 con 0x7f200806ea70 2023-03-06T14:16:11.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.306+0000 7f2006d9d700 1 --2- 172.21.15.3:0/3219722380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f200806ea70 0x7f20080bd670 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8006fd0 tx=0x7f1ff8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40429422a5378eb server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:11.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.306+0000 7f2005d9b700 1 -- 172.21.15.3:0/3219722380 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8005e30 con 0x7f200806ea70 2023-03-06T14:16:11.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.306+0000 7f2005d9b700 1 -- 172.21.15.3:0/3219722380 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff8006030 con 0x7f200806ea70 2023-03-06T14:16:11.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.306+0000 7f2005d9b700 1 -- 172.21.15.3:0/3219722380 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff80063c0 con 0x7f200806ea70 2023-03-06T14:16:11.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.306+0000 7f200d033700 1 -- 172.21.15.3:0/3219722380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f200806ea70 msgr2=0x7f20080bd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:11.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.306+0000 7f200d033700 1 --2- 172.21.15.3:0/3219722380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f200806ea70 0x7f20080bd670 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8006fd0 tx=0x7f1ff8009bd0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.306+0000 7f200d033700 1 -- 172.21.15.3:0/3219722380 shutdown_connections 2023-03-06T14:16:11.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.306+0000 7f200d033700 1 --2- 172.21.15.3:0/3219722380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f200806ea70 0x7f20080bd670 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.306+0000 7f200d033700 1 --2- 172.21.15.3:0/3219722380 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f200806ee40 0x7f20081490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.306+0000 7f200d033700 1 -- 172.21.15.3:0/3219722380 >> 172.21.15.3:0/3219722380 conn(0x7f20080c2150 msgr2=0x7f20080c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:11.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.306+0000 7f200d033700 1 -- 172.21.15.3:0/3219722380 shutdown_connections 2023-03-06T14:16:11.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.306+0000 7f200d033700 1 -- 172.21.15.3:0/3219722380 wait complete. 2023-03-06T14:16:11.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.308+0000 7f200d033700 1 Processor -- start 2023-03-06T14:16:11.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.308+0000 7f200d033700 1 -- start start 2023-03-06T14:16:11.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.308+0000 7f200d033700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f200806ea70 0x7f200814de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:11.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.308+0000 7f200d033700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f200806ee40 0x7f20080bad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:11.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.308+0000 7f200d033700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f20080bdd60 0x7f20080bb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:11.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.308+0000 7f200d033700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20081482e0 con 0x7f20080bdd60 2023-03-06T14:16:11.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.308+0000 7f200d033700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20080ba870 con 0x7f200806ee40 2023-03-06T14:16:11.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.308+0000 7f200d033700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200814e340 con 0x7f200806ea70 2023-03-06T14:16:11.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.309+0000 7f200759e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f20080bdd60 0x7f20080bb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:11.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.309+0000 7f200759e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f20080bdd60 0x7f20080bb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55808/0 (socket says 172.21.15.3:55808) 2023-03-06T14:16:11.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.309+0000 7f200759e700 1 -- 172.21.15.3:0/3881036748 learned_addr learned my addr 172.21.15.3:0/3881036748 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:11.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.309+0000 7f2006d9d700 1 --2- 172.21.15.3:0/3881036748 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f200806ea70 0x7f200814de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:11.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.309+0000 7f200659c700 1 --2- 172.21.15.3:0/3881036748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f200806ee40 0x7f20080bad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:11.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.309+0000 7f200759e700 1 -- 172.21.15.3:0/3881036748 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f200806ea70 msgr2=0x7f200814de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:11.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.309+0000 7f200759e700 1 --2- 172.21.15.3:0/3881036748 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f200806ea70 0x7f200814de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.309+0000 7f200759e700 1 -- 172.21.15.3:0/3881036748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f200806ee40 msgr2=0x7f20080bad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:11.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.309+0000 7f200759e700 1 --2- 172.21.15.3:0/3881036748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f200806ee40 0x7f20080bad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.309+0000 7f200759e700 1 -- 172.21.15.3:0/3881036748 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff8009500 con 0x7f20080bdd60 2023-03-06T14:16:11.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.309+0000 7f200759e700 1 --2- 172.21.15.3:0/3881036748 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f20080bdd60 0x7f20080bb240 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f200000b930 tx=0x7f200000bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:11.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.309+0000 7f1fef7fe700 1 -- 172.21.15.3:0/3881036748 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200000c9b0 con 0x7f20080bdd60 2023-03-06T14:16:11.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.309+0000 7f1fef7fe700 1 -- 172.21.15.3:0/3881036748 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200000cb10 con 0x7f20080bdd60 2023-03-06T14:16:11.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.309+0000 7f200d033700 1 -- 172.21.15.3:0/3881036748 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2008150220 con 0x7f20080bdd60 2023-03-06T14:16:11.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.309+0000 7f1fef7fe700 1 -- 172.21.15.3:0/3881036748 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2000014440 con 0x7f20080bdd60 2023-03-06T14:16:11.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.309+0000 7f200d033700 1 -- 172.21.15.3:0/3881036748 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20080bd150 con 0x7f20080bdd60 2023-03-06T14:16:11.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.310+0000 7f200d033700 1 -- 172.21.15.3:0/3881036748 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20080b8b80 con 0x7f20080bdd60 2023-03-06T14:16:11.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.311+0000 7f1fef7fe700 1 -- 172.21.15.3:0/3881036748 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f200001b030 con 0x7f20080bdd60 2023-03-06T14:16:11.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.311+0000 7f1fef7fe700 1 --2- 172.21.15.3:0/3881036748 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f1ff40682f0 0x7f1ff406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:11.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.311+0000 7f1fef7fe700 1 -- 172.21.15.3:0/3881036748 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2000085aa0 con 0x7f20080bdd60 2023-03-06T14:16:11.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.311+0000 7f2006d9d700 1 --2- 172.21.15.3:0/3881036748 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f1ff40682f0 0x7f1ff406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:11.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.312+0000 7f2006d9d700 1 --2- 172.21.15.3:0/3881036748 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f1ff40682f0 0x7f1ff406a7a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8013040 tx=0x7f1ff8008070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:11.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.315+0000 7f1fef7fe700 1 -- 172.21.15.3:0/3881036748 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2000052010 con 0x7f20080bdd60 2023-03-06T14:16:11.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.524+0000 7f200d033700 1 -- 172.21.15.3:0/3881036748 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f20080ba9e0 con 0x7f20080bdd60 2023-03-06T14:16:11.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.524+0000 7f1fef7fe700 1 -- 172.21.15.3:0/3881036748 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2000055630 con 0x7f20080bdd60 2023-03-06T14:16:11.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.526+0000 7f200d033700 1 -- 172.21.15.3:0/3881036748 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f1ff40682f0 msgr2=0x7f1ff406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:11.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.526+0000 7f200d033700 1 --2- 172.21.15.3:0/3881036748 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f1ff40682f0 0x7f1ff406a7a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8013040 tx=0x7f1ff8008070 comp rx=0 tx=0).stop 2023-03-06T14:16:11.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.526+0000 7f200d033700 1 -- 172.21.15.3:0/3881036748 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f20080bdd60 msgr2=0x7f20080bb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:11.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.526+0000 7f200d033700 1 --2- 172.21.15.3:0/3881036748 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f20080bdd60 0x7f20080bb240 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f200000b930 tx=0x7f200000bcf0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.526+0000 7f200d033700 1 -- 172.21.15.3:0/3881036748 shutdown_connections 2023-03-06T14:16:11.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.526+0000 7f200d033700 1 --2- 172.21.15.3:0/3881036748 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f1ff40682f0 0x7f1ff406a7a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.526+0000 7f200d033700 1 --2- 172.21.15.3:0/3881036748 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f20080bdd60 0x7f20080bb240 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.526+0000 7f200d033700 1 --2- 172.21.15.3:0/3881036748 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f200806ea70 0x7f200814de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.526+0000 7f200d033700 1 --2- 172.21.15.3:0/3881036748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f200806ee40 0x7f20080bad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.526+0000 7f200d033700 1 -- 172.21.15.3:0/3881036748 >> 172.21.15.3:0/3881036748 conn(0x7f20080c2150 msgr2=0x7f20080b7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:11.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.526+0000 7f200d033700 1 -- 172.21.15.3:0/3881036748 shutdown_connections 2023-03-06T14:16:11.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.526+0000 7f200d033700 1 -- 172.21.15.3:0/3881036748 wait complete. 2023-03-06T14:16:11.530 INFO:teuthology.orchestra.run.smithi003.stderr:listed 0 entries 2023-03-06T14:16:11.539 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:16:11.539 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-06T14:16:11.556 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T14:16:11.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.720+0000 7f64676a9700 1 Processor -- start 2023-03-06T14:16:11.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.720+0000 7f64676a9700 1 -- start start 2023-03-06T14:16:11.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f64676a9700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f64600b8140 0x7f646006e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:11.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f64676a9700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f646006edd0 0x7f6460156900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:11.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f64676a9700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646006fc80 con 0x7f6460146130 2023-03-06T14:16:11.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f64676a9700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646014cb30 con 0x7f646006edd0 2023-03-06T14:16:11.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f64676a9700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646006f520 con 0x7f64600b8140 2023-03-06T14:16:11.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f6465445700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f6460146130 0x7f646014f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58084/0 (socket says 172.21.15.3:58084) 2023-03-06T14:16:11.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f6465445700 1 -- 172.21.15.3:0/4029036413 learned_addr learned my addr 172.21.15.3:0/4029036413 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:11.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f6465c46700 1 --2- 172.21.15.3:0/4029036413 >> v2:172.21.15.136:3300/0 conn(0x7f646006edd0 0x7f6460156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:11.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f6464c44700 1 --2- 172.21.15.3:0/4029036413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f64600b8140 0x7f646006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:11.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f6457fff700 1 -- 172.21.15.3:0/4029036413 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029651524 0 0) 0x7f646006fc80 con 0x7f6460146130 2023-03-06T14:16:11.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f6457fff700 1 -- 172.21.15.3:0/4029036413 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f644c0035b0 con 0x7f6460146130 2023-03-06T14:16:11.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f6457fff700 1 -- 172.21.15.3:0/4029036413 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1989331928 0 0) 0x7f644c0035b0 con 0x7f6460146130 2023-03-06T14:16:11.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f6457fff700 1 -- 172.21.15.3:0/4029036413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f64600b8140 msgr2=0x7f646006e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:11.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f6457fff700 1 --2- 172.21.15.3:0/4029036413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f64600b8140 0x7f646006e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f6457fff700 1 -- 172.21.15.3:0/4029036413 >> v2:172.21.15.136:3300/0 conn(0x7f646006edd0 msgr2=0x7f6460156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:11.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f6457fff700 1 --2- 172.21.15.3:0/4029036413 >> v2:172.21.15.136:3300/0 conn(0x7f646006edd0 0x7f6460156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f6457fff700 1 -- 172.21.15.3:0/4029036413 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646006f9a0 con 0x7f6460146130 2023-03-06T14:16:11.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f6457fff700 1 -- 172.21.15.3:0/4029036413 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3255535284 0 0) 0x7f64500017f0 con 0x7f6460146130 2023-03-06T14:16:11.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f6457fff700 1 -- 172.21.15.3:0/4029036413 >> v1:172.21.15.3:6789/0 conn(0x7f6460146130 legacy=0x7f646014f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:11.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.721+0000 7f6457fff700 1 --2- 172.21.15.3:0/4029036413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f644c003a00 0x7f644c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:11.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.722+0000 7f6457fff700 1 --2- 172.21.15.3:0/4029036413 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644c0043e0 0x7f644c0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:11.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.722+0000 7f6457fff700 1 --2- 172.21.15.3:0/4029036413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f644c004fc0 0x7f644c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:11.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.722+0000 7f6457fff700 1 -- 172.21.15.3:0/4029036413 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646014cb30 con 0x7f644c0043e0 2023-03-06T14:16:11.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.722+0000 7f6457fff700 1 -- 172.21.15.3:0/4029036413 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646006f520 con 0x7f644c004fc0 2023-03-06T14:16:11.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.722+0000 7f6457fff700 1 -- 172.21.15.3:0/4029036413 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644c00bf50 con 0x7f644c003a00 2023-03-06T14:16:11.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.722+0000 7f6465c46700 1 --2- 172.21.15.3:0/4029036413 >> v2:172.21.15.136:3300/0 conn(0x7f646006edd0 0x7f6460156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:16:11.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.722+0000 7f6464c44700 1 --2- 172.21.15.3:0/4029036413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f64600b8140 0x7f646006e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:16:11.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.722+0000 7f6464c44700 1 --2- 172.21.15.3:0/4029036413 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644c0043e0 0x7f644c0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:11.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.722+0000 7f6465445700 1 --2- 172.21.15.3:0/4029036413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f644c003a00 0x7f644c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:11.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.722+0000 7f6465c46700 1 --2- 172.21.15.3:0/4029036413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f644c004fc0 0x7f644c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:11.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.722+0000 7f6464c44700 1 -- 172.21.15.3:0/4029036413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f644c003a00 msgr2=0x7f644c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:11.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.722+0000 7f6464c44700 1 --2- 172.21.15.3:0/4029036413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f644c003a00 0x7f644c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.722+0000 7f6464c44700 1 -- 172.21.15.3:0/4029036413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f644c004fc0 msgr2=0x7f644c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:11.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.722+0000 7f6464c44700 1 --2- 172.21.15.3:0/4029036413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f644c004fc0 0x7f644c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.722+0000 7f6464c44700 1 -- 172.21.15.3:0/4029036413 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c0035b0 con 0x7f644c0043e0 2023-03-06T14:16:11.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.722+0000 7f6464c44700 1 --2- 172.21.15.3:0/4029036413 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644c0043e0 0x7f644c0048b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f645c009ba0 tx=0x7f644c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93805357cdc08248 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:11.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.722+0000 7f6457fff700 1 -- 172.21.15.3:0/4029036413 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c004030 con 0x7f644c0043e0 2023-03-06T14:16:11.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.722+0000 7f6457fff700 1 -- 172.21.15.3:0/4029036413 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c004190 con 0x7f644c0043e0 2023-03-06T14:16:11.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.722+0000 7f6457fff700 1 -- 172.21.15.3:0/4029036413 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c004540 con 0x7f644c0043e0 2023-03-06T14:16:11.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.723+0000 7f64676a9700 1 -- 172.21.15.3:0/4029036413 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644c0043e0 msgr2=0x7f644c0048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:11.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.723+0000 7f64676a9700 1 --2- 172.21.15.3:0/4029036413 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644c0043e0 0x7f644c0048b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f645c009ba0 tx=0x7f644c005880 comp rx=0 tx=0).stop 2023-03-06T14:16:11.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.723+0000 7f6465c46700 1 -- 172.21.15.3:0/4029036413 reap_dead start 2023-03-06T14:16:11.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.723+0000 7f64676a9700 1 -- 172.21.15.3:0/4029036413 shutdown_connections 2023-03-06T14:16:11.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.723+0000 7f64676a9700 1 -- 172.21.15.3:0/4029036413 >> 172.21.15.3:0/4029036413 conn(0x7f64600c2150 msgr2=0x7f64600c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:11.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.723+0000 7f64676a9700 1 -- 172.21.15.3:0/4029036413 shutdown_connections 2023-03-06T14:16:11.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.723+0000 7f64676a9700 1 -- 172.21.15.3:0/4029036413 wait complete. 2023-03-06T14:16:11.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.724+0000 7f64676a9700 1 Processor -- start 2023-03-06T14:16:11.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.724+0000 7f64676a9700 1 -- start start 2023-03-06T14:16:11.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.725+0000 7f64676a9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644c0043e0 0x7f6460148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:11.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.725+0000 7f64676a9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64601d53d0 0x7f64601d64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:11.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.725+0000 7f64676a9700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f64601d5840 0x7f64601d6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:11.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.725+0000 7f64676a9700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6460149800 con 0x7f644c0043e0 2023-03-06T14:16:11.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.725+0000 7f64676a9700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64601491f0 con 0x7f64601d53d0 2023-03-06T14:16:11.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.725+0000 7f64676a9700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64601d5f10 con 0x7f64601d5840 2023-03-06T14:16:11.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.725+0000 7f6465445700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644c0043e0 0x7f6460148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:11.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.725+0000 7f6465445700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644c0043e0 0x7f6460148cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55824/0 (socket says 172.21.15.3:55824) 2023-03-06T14:16:11.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.725+0000 7f6465445700 1 -- 172.21.15.3:0/3852239563 learned_addr learned my addr 172.21.15.3:0/3852239563 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:11.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.725+0000 7f6465c46700 1 --2- 172.21.15.3:0/3852239563 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f64601d5840 0x7f64601d6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:11.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.725+0000 7f6464c44700 1 --2- 172.21.15.3:0/3852239563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64601d53d0 0x7f64601d64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:11.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.725+0000 7f6465445700 1 -- 172.21.15.3:0/3852239563 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f64601d5840 msgr2=0x7f64601d6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:11.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.725+0000 7f6465445700 1 --2- 172.21.15.3:0/3852239563 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f64601d5840 0x7f64601d6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.725+0000 7f6465445700 1 -- 172.21.15.3:0/3852239563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64601d53d0 msgr2=0x7f64601d64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:11.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.725+0000 7f6465445700 1 --2- 172.21.15.3:0/3852239563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64601d53d0 0x7f64601d64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.725+0000 7f6465445700 1 -- 172.21.15.3:0/3852239563 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64600b8b50 con 0x7f644c0043e0 2023-03-06T14:16:11.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.725+0000 7f6465c46700 1 --2- 172.21.15.3:0/3852239563 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f64601d5840 0x7f64601d6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:11.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.725+0000 7f6464c44700 1 --2- 172.21.15.3:0/3852239563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64601d53d0 0x7f64601d64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:11.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.725+0000 7f6465445700 1 --2- 172.21.15.3:0/3852239563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644c0043e0 0x7f6460148cb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f645000f8c0 tx=0x7f645000fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:11.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.726+0000 7f6455ffb700 1 -- 172.21.15.3:0/3852239563 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645000fec0 con 0x7f644c0043e0 2023-03-06T14:16:11.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.726+0000 7f6455ffb700 1 -- 172.21.15.3:0/3852239563 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64500072e0 con 0x7f644c0043e0 2023-03-06T14:16:11.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.726+0000 7f6455ffb700 1 -- 172.21.15.3:0/3852239563 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6450007670 con 0x7f644c0043e0 2023-03-06T14:16:11.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.726+0000 7f64676a9700 1 -- 172.21.15.3:0/3852239563 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64600b8870 con 0x7f644c0043e0 2023-03-06T14:16:11.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.726+0000 7f64676a9700 1 -- 172.21.15.3:0/3852239563 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64600b7110 con 0x7f644c0043e0 2023-03-06T14:16:11.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.727+0000 7f64676a9700 1 -- 172.21.15.3:0/3852239563 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64600bc3e0 con 0x7f644c0043e0 2023-03-06T14:16:11.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.727+0000 7f6455ffb700 1 -- 172.21.15.3:0/3852239563 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6450005830 con 0x7f644c0043e0 2023-03-06T14:16:11.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.727+0000 7f6455ffb700 1 --2- 172.21.15.3:0/3852239563 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f64440682f0 0x7f644406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:11.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.728+0000 7f6455ffb700 1 -- 172.21.15.3:0/3852239563 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6450086120 con 0x7f644c0043e0 2023-03-06T14:16:11.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.728+0000 7f6464c44700 1 --2- 172.21.15.3:0/3852239563 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f64440682f0 0x7f644406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:11.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.728+0000 7f6464c44700 1 --2- 172.21.15.3:0/3852239563 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f64440682f0 0x7f644406a7a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f644c0047d0 tx=0x7f645c008070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:11.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.732+0000 7f6455ffb700 1 -- 172.21.15.3:0/3852239563 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f64600bc3e0 con 0x7f644c0043e0 2023-03-06T14:16:11.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.925+0000 7f64676a9700 1 -- 172.21.15.3:0/3852239563 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64600bc3e0 con 0x7f644c0043e0 2023-03-06T14:16:11.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.927+0000 7f6455ffb700 1 -- 172.21.15.3:0/3852239563 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19604 (secure 0 0 0) 0x7f64600bc3e0 con 0x7f644c0043e0 2023-03-06T14:16:11.928 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:11.928 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":27,"fsid":"9aae2361-5af0-49eb-8f99-e7f69834fedf","created":"2023-03-06T14:15:33.357348+0000","modified":"2023-03-06T14:16:03.040402+0000","last_up_change":"2023-03-06T14:15:44.374764+0000","last_in_change":"2023-03-06T14:15:35.866803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T14:15:45.023761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T14:15:51.830917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-06T14:15:56.256188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-06T14:15:57.571429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-06T14:16:00.645210+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c92c9e49-8a23-48a5-87e5-51f184f73a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":96679},{"type":"v1","addr":"172.21.15.3:6809","nonce":96679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":96679},{"type":"v1","addr":"172.21.15.3:6811","nonce":96679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":96679},{"type":"v1","addr":"172.21.15.3:6818","nonce":96679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":96679},{"type":"v1","addr":"172.21.15.3:6814","nonce":96679}]},"public_addr":"172.21.15.3:6809/96679","cluster_addr":"172.21.15.3:6811/96679","heartbeat_back_addr":"172.21.15.3:6818/96679","heartbeat_front_addr":"172.21.15.3:6814/96679","state":["exists","up"]},{"osd":1,"uuid":"86ec9127-843f-4246-bfbe-e14ce3af7d17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":96681},{"type":"v1","addr":"172.21.15.3:6825","nonce":96681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":96681},{"type":"v1","addr":"172.21.15.3:6827","nonce":96681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":96681},{"type":"v1","addr":"172.21.15.3:6831","nonce":96681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":96681},{"type":"v1","addr":"172.21.15.3:6829","nonce":96681}]},"public_addr":"172.21.15.3:6825/96681","cluster_addr":"172.21.15.3:6827/96681","heartbeat_back_addr":"172.21.15.3:6831/96681","heartbeat_front_addr":"172.21.15.3:6829/96681","state":["exists","up"]},{"osd":2,"uuid":"67582de3-0f75-4cf0-84ca-e878986f99f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":96682},{"type":"v1","addr":"172.21.15.3:6815","nonce":96682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6817","nonce":96682},{"type":"v1","addr":"172.21.15.3:6819","nonce":96682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":96682},{"type":"v1","addr":"172.21.15.3:6823","nonce":96682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":96682},{"type":"v1","addr":"172.21.15.3:6821","nonce":96682}]},"public_addr":"172.21.15.3:6815/96682","cluster_addr":"172.21.15.3:6819/96682","heartbeat_back_addr":"172.21.15.3:6823/96682","heartbeat_front_addr":"172.21.15.3:6821/96682","state":["exists","up"]},{"osd":3,"uuid":"0fb8d708-4b38-4153-8a60-79741765d439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":96680},{"type":"v1","addr":"172.21.15.3:6801","nonce":96680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":96680},{"type":"v1","addr":"172.21.15.3:6803","nonce":96680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":96680},{"type":"v1","addr":"172.21.15.3:6807","nonce":96680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":96680},{"type":"v1","addr":"172.21.15.3:6805","nonce":96680}]},"public_addr":"172.21.15.3:6801/96680","cluster_addr":"172.21.15.3:6803/96680","heartbeat_back_addr":"172.21.15.3:6807/96680","heartbeat_front_addr":"172.21.15.3:6805/96680","state":["exists","up"]},{"osd":4,"uuid":"44eb9d99-975f-43a3-8bf4-213b2ba6dea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":96798},{"type":"v1","addr":"172.21.15.136:6822","nonce":96798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":96798},{"type":"v1","addr":"172.21.15.136:6826","nonce":96798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":96798},{"type":"v1","addr":"172.21.15.136:6831","nonce":96798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":96798},{"type":"v1","addr":"172.21.15.136:6829","nonce":96798}]},"public_addr":"172.21.15.136:6822/96798","cluster_addr":"172.21.15.136:6826/96798","heartbeat_back_addr":"172.21.15.136:6831/96798","heartbeat_front_addr":"172.21.15.136:6829/96798","state":["exists","up"]},{"osd":5,"uuid":"aff1a438-c444-4ebc-9806-d2d117878a2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":96796},{"type":"v1","addr":"172.21.15.136:6804","nonce":96796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":96796},{"type":"v1","addr":"172.21.15.136:6809","nonce":96796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":96796},{"type":"v1","addr":"172.21.15.136:6815","nonce":96796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":96796},{"type":"v1","addr":"172.21.15.136:6813","nonce":96796}]},"public_addr":"172.21.15.136:6804/96796","cluster_addr":"172.21.15.136:6809/96796","heartbeat_back_addr":"172.21.15.136:6815/96796","heartbeat_front_addr":"172.21.15.136:6813/96796","state":["exists","up"]},{"osd":6,"uuid":"89cc219c-f57b-43f4-8e54-76017dd4930d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":96797},{"type":"v1","addr":"172.21.15.136:6801","nonce":96797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6803","nonce":96797},{"type":"v1","addr":"172.21.15.136:6805","nonce":96797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":96797},{"type":"v1","addr":"172.21.15.136:6811","nonce":96797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":96797},{"type":"v1","addr":"172.21.15.136:6808","nonce":96797}]},"public_addr":"172.21.15.136:6801/96797","cluster_addr":"172.21.15.136:6805/96797","heartbeat_back_addr":"172.21.15.136:6811/96797","heartbeat_front_addr":"172.21.15.136:6808/96797","state":["exists","up"]},{"osd":7,"uuid":"a90e4c14-00de-4d1c-92ce-9f20df714e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":96819},{"type":"v1","addr":"172.21.15.136:6817","nonce":96819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":96819},{"type":"v1","addr":"172.21.15.136:6819","nonce":96819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":96819},{"type":"v1","addr":"172.21.15.136:6827","nonce":96819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":96819},{"type":"v1","addr":"172.21.15.136:6823","nonce":96819}]},"public_addr":"172.21.15.136:6817/96819","cluster_addr":"172.21.15.136:6819/96819","heartbeat_back_addr":"172.21.15.136:6827/96819","heartbeat_front_addr":"172.21.15.136:6823/96819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.093141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.034488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.128137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.097924+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.045441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.005820+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.039918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.082053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T14:16:11.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.929+0000 7f64676a9700 1 -- 172.21.15.3:0/3852239563 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f64440682f0 msgr2=0x7f644406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:11.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.929+0000 7f64676a9700 1 --2- 172.21.15.3:0/3852239563 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f64440682f0 0x7f644406a7a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f644c0047d0 tx=0x7f645c008070 comp rx=0 tx=0).stop 2023-03-06T14:16:11.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.929+0000 7f64676a9700 1 -- 172.21.15.3:0/3852239563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644c0043e0 msgr2=0x7f6460148cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:11.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.929+0000 7f64676a9700 1 --2- 172.21.15.3:0/3852239563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644c0043e0 0x7f6460148cb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f645000f8c0 tx=0x7f645000fc80 comp rx=0 tx=0).stop 2023-03-06T14:16:11.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.929+0000 7f64676a9700 1 -- 172.21.15.3:0/3852239563 shutdown_connections 2023-03-06T14:16:11.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.929+0000 7f64676a9700 1 --2- 172.21.15.3:0/3852239563 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f64440682f0 0x7f644406a7a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.929+0000 7f64676a9700 1 --2- 172.21.15.3:0/3852239563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f644c0043e0 0x7f6460148cb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.929+0000 7f64676a9700 1 --2- 172.21.15.3:0/3852239563 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f64601d5840 0x7f64601d6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.929+0000 7f64676a9700 1 --2- 172.21.15.3:0/3852239563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64601d53d0 0x7f64601d64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:11.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.929+0000 7f64676a9700 1 -- 172.21.15.3:0/3852239563 >> 172.21.15.3:0/3852239563 conn(0x7f64600c2150 msgr2=0x7f6460071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:11.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.929+0000 7f64676a9700 1 -- 172.21.15.3:0/3852239563 shutdown_connections 2023-03-06T14:16:11.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:11.929+0000 7f64676a9700 1 -- 172.21.15.3:0/3852239563 wait complete. 2023-03-06T14:16:11.942 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-06T14:15:45.023761+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-06T14:15:51.830917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-06T14:15:56.256188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-06T14:15:57.571429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-06T14:16:00.645210+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-06T14:16:11.943 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-06T14:16:12.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.069+0000 7fc49a498700 1 Processor -- start 2023-03-06T14:16:12.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.069+0000 7fc49a498700 1 -- start start 2023-03-06T14:16:12.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.070+0000 7fc49a498700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc494146130 0x7fc49414f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.070+0000 7fc49a498700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc4940b9070 0x7fc494156900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.070+0000 7fc49a498700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc49414fab0 con 0x7fc4940b8140 2023-03-06T14:16:12.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.070+0000 7fc49a498700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc49406fc80 con 0x7fc4940b9070 2023-03-06T14:16:12.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.070+0000 7fc49a498700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49414cb30 con 0x7fc494146130 2023-03-06T14:16:12.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.070+0000 7fc493fff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc494146130 0x7fc49414f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.070+0000 7fc498a35700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc4940b9070 0x7fc494156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.070+0000 7fc4937fe700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fc4940b8140 0x7fc49406e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.3:55588/0 (socket says 172.21.15.3:55588) 2023-03-06T14:16:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.070+0000 7fc498a35700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc4940b9070 0x7fc494156900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.3:41924/0 (socket says 172.21.15.3:41924) 2023-03-06T14:16:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.070+0000 7fc4937fe700 1 -- 172.21.15.3:0/4270447649 learned_addr learned my addr 172.21.15.3:0/4270447649 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.070+0000 7fc493fff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc494146130 0x7fc49414f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.3:48810/0 (socket says 172.21.15.3:48810) 2023-03-06T14:16:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.070+0000 7fc498a35700 1 -- 172.21.15.3:0/4270447649 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc494146130 msgr2=0x7fc49414f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.070+0000 7fc498a35700 1 --2- 172.21.15.3:0/4270447649 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc494146130 0x7fc49414f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.071+0000 7fc498a35700 1 -- 172.21.15.3:0/4270447649 >> v1:172.21.15.136:6789/0 conn(0x7fc4940b8140 legacy=0x7fc49406e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.071+0000 7fc498a35700 1 -- 172.21.15.3:0/4270447649 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49406f520 con 0x7fc4940b9070 2023-03-06T14:16:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.071+0000 7fc492ffd700 1 -- 172.21.15.3:0/4270447649 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451291423 0 0) 0x7fc49414fab0 con 0x7fc4940b8140 2023-03-06T14:16:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.071+0000 7fc498a35700 1 --2- 172.21.15.3:0/4270447649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4940b9070 0x7fc494156900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc48c009d90 tx=0x7fc48c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecfac4b1d327b6ac server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.071+0000 7fc492ffd700 1 -- 172.21.15.3:0/4270447649 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c00e070 con 0x7fc4940b9070 2023-03-06T14:16:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.071+0000 7fc492ffd700 1 -- 172.21.15.3:0/4270447649 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48c00bb20 con 0x7fc4940b9070 2023-03-06T14:16:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.071+0000 7fc492ffd700 1 -- 172.21.15.3:0/4270447649 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c012430 con 0x7fc4940b9070 2023-03-06T14:16:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.071+0000 7fc49a498700 1 -- 172.21.15.3:0/4270447649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4940b9070 msgr2=0x7fc494156900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.071+0000 7fc49a498700 1 --2- 172.21.15.3:0/4270447649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4940b9070 0x7fc494156900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc48c009d90 tx=0x7fc48c00b330 comp rx=0 tx=0).stop 2023-03-06T14:16:12.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.071+0000 7fc49a498700 1 -- 172.21.15.3:0/4270447649 shutdown_connections 2023-03-06T14:16:12.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.071+0000 7fc49a498700 1 --2- 172.21.15.3:0/4270447649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4940b9070 0x7fc494156900 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.071+0000 7fc49a498700 1 --2- 172.21.15.3:0/4270447649 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc494146130 0x7fc49414f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.071+0000 7fc49a498700 1 -- 172.21.15.3:0/4270447649 >> 172.21.15.3:0/4270447649 conn(0x7fc4940c2150 msgr2=0x7fc4940c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:12.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.071+0000 7fc49a498700 1 -- 172.21.15.3:0/4270447649 shutdown_connections 2023-03-06T14:16:12.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.071+0000 7fc49a498700 1 -- 172.21.15.3:0/4270447649 wait complete. 2023-03-06T14:16:12.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.073+0000 7fc49a498700 1 Processor -- start 2023-03-06T14:16:12.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.073+0000 7fc49a498700 1 -- start start 2023-03-06T14:16:12.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.073+0000 7fc49a498700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4940b8140 0x7fc494149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.073+0000 7fc49a498700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc4940b9070 0x7fc4941e63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.073+0000 7fc49a498700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc494146130 0x7fc49413eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.073+0000 7fc49a498700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4941481b0 con 0x7fc494146130 2023-03-06T14:16:12.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.073+0000 7fc49a498700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4941e5bc0 con 0x7fc4940b8140 2023-03-06T14:16:12.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.073+0000 7fc49a498700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc494148400 con 0x7fc4940b9070 2023-03-06T14:16:12.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.074+0000 7fc498a35700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc494146130 0x7fc49413eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.074+0000 7fc498a35700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc494146130 0x7fc49413eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55840/0 (socket says 172.21.15.3:55840) 2023-03-06T14:16:12.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.074+0000 7fc498a35700 1 -- 172.21.15.3:0/3177232845 learned_addr learned my addr 172.21.15.3:0/3177232845 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:12.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.074+0000 7fc493fff700 1 --2- 172.21.15.3:0/3177232845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4940b8140 0x7fc494149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.074+0000 7fc4937fe700 1 --2- 172.21.15.3:0/3177232845 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc4940b9070 0x7fc4941e63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.074+0000 7fc498a35700 1 -- 172.21.15.3:0/3177232845 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc4940b9070 msgr2=0x7fc4941e63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:12.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.074+0000 7fc498a35700 1 --2- 172.21.15.3:0/3177232845 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc4940b9070 0x7fc4941e63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.074+0000 7fc498a35700 1 -- 172.21.15.3:0/3177232845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4940b8140 msgr2=0x7fc494149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:12.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.074+0000 7fc498a35700 1 --2- 172.21.15.3:0/3177232845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4940b8140 0x7fc494149390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.074+0000 7fc498a35700 1 -- 172.21.15.3:0/3177232845 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c009a70 con 0x7fc494146130 2023-03-06T14:16:12.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.074+0000 7fc493fff700 1 --2- 172.21.15.3:0/3177232845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4940b8140 0x7fc494149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:16:12.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.074+0000 7fc498a35700 1 --2- 172.21.15.3:0/3177232845 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc494146130 0x7fc49413eee0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc48c014040 tx=0x7fc48c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:12.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.074+0000 7fc490ff9700 1 -- 172.21.15.3:0/3177232845 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c012430 con 0x7fc494146130 2023-03-06T14:16:12.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.074+0000 7fc490ff9700 1 -- 172.21.15.3:0/3177232845 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48c020070 con 0x7fc494146130 2023-03-06T14:16:12.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.074+0000 7fc49a498700 1 -- 172.21.15.3:0/3177232845 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4940b8870 con 0x7fc494146130 2023-03-06T14:16:12.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.074+0000 7fc490ff9700 1 -- 172.21.15.3:0/3177232845 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c004280 con 0x7fc494146130 2023-03-06T14:16:12.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.074+0000 7fc49a498700 1 -- 172.21.15.3:0/3177232845 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49406f9a0 con 0x7fc494146130 2023-03-06T14:16:12.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.075+0000 7fc49a498700 1 -- 172.21.15.3:0/3177232845 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4940b8b50 con 0x7fc494146130 2023-03-06T14:16:12.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.076+0000 7fc490ff9700 1 -- 172.21.15.3:0/3177232845 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc48c0043e0 con 0x7fc494146130 2023-03-06T14:16:12.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.076+0000 7fc490ff9700 1 --2- 172.21.15.3:0/3177232845 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc4740682f0 0x7fc47406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.076+0000 7fc490ff9700 1 -- 172.21.15.3:0/3177232845 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc48c022070 con 0x7fc494146130 2023-03-06T14:16:12.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.076+0000 7fc493fff700 1 --2- 172.21.15.3:0/3177232845 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc4740682f0 0x7fc47406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.077+0000 7fc493fff700 1 --2- 172.21.15.3:0/3177232845 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc4740682f0 0x7fc47406a7a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc484009fb0 tx=0x7fc4840091c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:12.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.081+0000 7fc490ff9700 1 -- 172.21.15.3:0/3177232845 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc48c0547c0 con 0x7fc494146130 2023-03-06T14:16:12.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.273+0000 7fc49a498700 1 -- 172.21.15.3:0/3177232845 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc4940b7110 con 0x7fc494146130 2023-03-06T14:16:12.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.273+0000 7fc490ff9700 1 -- 172.21.15.3:0/3177232845 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc48c057de0 con 0x7fc494146130 2023-03-06T14:16:12.275 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-03-06T14:16:12.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.275+0000 7fc49a498700 1 -- 172.21.15.3:0/3177232845 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc4740682f0 msgr2=0x7fc47406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:12.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.275+0000 7fc49a498700 1 --2- 172.21.15.3:0/3177232845 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc4740682f0 0x7fc47406a7a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc484009fb0 tx=0x7fc4840091c0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.275+0000 7fc49a498700 1 -- 172.21.15.3:0/3177232845 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc494146130 msgr2=0x7fc49413eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:12.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.275+0000 7fc49a498700 1 --2- 172.21.15.3:0/3177232845 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc494146130 0x7fc49413eee0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc48c014040 tx=0x7fc48c004ad0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.275+0000 7fc49a498700 1 -- 172.21.15.3:0/3177232845 shutdown_connections 2023-03-06T14:16:12.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.275+0000 7fc49a498700 1 --2- 172.21.15.3:0/3177232845 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc4740682f0 0x7fc47406a7a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.275+0000 7fc49a498700 1 --2- 172.21.15.3:0/3177232845 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc494146130 0x7fc49413eee0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.275+0000 7fc49a498700 1 --2- 172.21.15.3:0/3177232845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4940b8140 0x7fc494149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.275+0000 7fc49a498700 1 --2- 172.21.15.3:0/3177232845 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc4940b9070 0x7fc4941e63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.275+0000 7fc49a498700 1 -- 172.21.15.3:0/3177232845 >> 172.21.15.3:0/3177232845 conn(0x7fc4940c2150 msgr2=0x7fc4940c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:12.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.275+0000 7fc49a498700 1 -- 172.21.15.3:0/3177232845 shutdown_connections 2023-03-06T14:16:12.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.275+0000 7fc49a498700 1 -- 172.21.15.3:0/3177232845 wait complete. 2023-03-06T14:16:12.288 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-06T14:16:12.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.414+0000 7fc022936700 1 Processor -- start 2023-03-06T14:16:12.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.414+0000 7fc022936700 1 -- start start 2023-03-06T14:16:12.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.414+0000 7fc022936700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc01c0b9070 0x7fc01c157910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.414+0000 7fc022936700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01c06fc80 con 0x7fc01c0b8140 2023-03-06T14:16:12.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.414+0000 7fc022936700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01c14cb30 con 0x7fc01c146130 2023-03-06T14:16:12.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.414+0000 7fc022936700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01c06f520 con 0x7fc01c0b9070 2023-03-06T14:16:12.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc01b7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fc01c0b8140 0x7fc01c06e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58116/0 (socket says 172.21.15.3:58116) 2023-03-06T14:16:12.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc01b7fe700 1 -- 172.21.15.3:0/823233435 learned_addr learned my addr 172.21.15.3:0/823233435 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:12.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc01affd700 1 -- 172.21.15.3:0/823233435 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232136236 0 0) 0x7fc01c06fc80 con 0x7fc01c0b8140 2023-03-06T14:16:12.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc020ed3700 1 --2- 172.21.15.3:0/823233435 >> v2:172.21.15.136:3300/0 conn(0x7fc01c0b9070 0x7fc01c157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc01affd700 1 -- 172.21.15.3:0/823233435 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0040035b0 con 0x7fc01c0b8140 2023-03-06T14:16:12.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc01affd700 1 -- 172.21.15.3:0/823233435 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2839192993 0 0) 0x7fc0040035b0 con 0x7fc01c0b8140 2023-03-06T14:16:12.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc01affd700 1 -- 172.21.15.3:0/823233435 >> v2:172.21.15.136:3300/0 conn(0x7fc01c0b9070 msgr2=0x7fc01c157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:12.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc01affd700 1 --2- 172.21.15.3:0/823233435 >> v2:172.21.15.136:3300/0 conn(0x7fc01c0b9070 0x7fc01c157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc01affd700 1 -- 172.21.15.3:0/823233435 >> v1:172.21.15.136:6789/0 conn(0x7fc01c146130 legacy=0x7fc01c14f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:12.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc01affd700 1 -- 172.21.15.3:0/823233435 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c06f9a0 con 0x7fc01c0b8140 2023-03-06T14:16:12.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc01affd700 1 -- 172.21.15.3:0/823233435 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3255535284 0 0) 0x7fc010001670 con 0x7fc01c0b8140 2023-03-06T14:16:12.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc01affd700 1 -- 172.21.15.3:0/823233435 >> v1:172.21.15.3:6789/0 conn(0x7fc01c0b8140 legacy=0x7fc01c06e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:12.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc01affd700 1 --2- 172.21.15.3:0/823233435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc004003a00 0x7fc004003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc01affd700 1 --2- 172.21.15.3:0/823233435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0040043f0 0x7fc0040048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc01affd700 1 --2- 172.21.15.3:0/823233435 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc004005150 0x7fc00400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc01affd700 1 -- 172.21.15.3:0/823233435 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c06f520 con 0x7fc004003a00 2023-03-06T14:16:12.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc01affd700 1 -- 172.21.15.3:0/823233435 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00400c080 con 0x7fc0040043f0 2023-03-06T14:16:12.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc01affd700 1 -- 172.21.15.3:0/823233435 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00400c240 con 0x7fc004005150 2023-03-06T14:16:12.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc01bfff700 1 --2- 172.21.15.3:0/823233435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc004003a00 0x7fc004003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.415+0000 7fc01b7fe700 1 --2- 172.21.15.3:0/823233435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0040043f0 0x7fc0040048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.416+0000 7fc020ed3700 1 --2- 172.21.15.3:0/823233435 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc004005150 0x7fc00400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.416+0000 7fc01bfff700 1 -- 172.21.15.3:0/823233435 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc004005150 msgr2=0x7fc00400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:12.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.416+0000 7fc01bfff700 1 --2- 172.21.15.3:0/823233435 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc004005150 0x7fc00400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.416+0000 7fc01bfff700 1 -- 172.21.15.3:0/823233435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0040043f0 msgr2=0x7fc0040048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:12.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.416+0000 7fc01bfff700 1 --2- 172.21.15.3:0/823233435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0040043f0 0x7fc0040048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.416+0000 7fc020ed3700 1 -- 172.21.15.3:0/823233435 reap_dead start 2023-03-06T14:16:12.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.416+0000 7fc01bfff700 1 -- 172.21.15.3:0/823233435 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0040035b0 con 0x7fc004003a00 2023-03-06T14:16:12.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.416+0000 7fc01bfff700 1 --2- 172.21.15.3:0/823233435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc004003a00 0x7fc004003dd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc00c001930 tx=0x7fc004005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e01ca3bd702f2d7 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:12.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.416+0000 7fc01affd700 1 -- 172.21.15.3:0/823233435 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c0013a0 con 0x7fc004003a00 2023-03-06T14:16:12.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.416+0000 7fc01affd700 1 -- 172.21.15.3:0/823233435 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c00c690 con 0x7fc004003a00 2023-03-06T14:16:12.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.416+0000 7fc01affd700 1 -- 172.21.15.3:0/823233435 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00ca40 con 0x7fc004003a00 2023-03-06T14:16:12.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.416+0000 7fc022936700 1 -- 172.21.15.3:0/823233435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc004003a00 msgr2=0x7fc004003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:12.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.416+0000 7fc022936700 1 --2- 172.21.15.3:0/823233435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc004003a00 0x7fc004003dd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc00c001930 tx=0x7fc004005880 comp rx=0 tx=0).stop 2023-03-06T14:16:12.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.416+0000 7fc022936700 1 -- 172.21.15.3:0/823233435 shutdown_connections 2023-03-06T14:16:12.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.416+0000 7fc022936700 1 --2- 172.21.15.3:0/823233435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc004003a00 0x7fc004003dd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.416+0000 7fc022936700 1 -- 172.21.15.3:0/823233435 >> 172.21.15.3:0/823233435 conn(0x7fc01c0c2150 msgr2=0x7fc01c0c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:12.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.417+0000 7fc022936700 1 -- 172.21.15.3:0/823233435 shutdown_connections 2023-03-06T14:16:12.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.417+0000 7fc022936700 1 -- 172.21.15.3:0/823233435 wait complete. 2023-03-06T14:16:12.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.418+0000 7fc022936700 1 Processor -- start 2023-03-06T14:16:12.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.418+0000 7fc022936700 1 -- start start 2023-03-06T14:16:12.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.418+0000 7fc022936700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc004003a00 0x7fc01c1e01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.418+0000 7fc022936700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc01c0b94d0 0x7fc01c14e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc022936700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc01c14ee50 0x7fc01c13cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc022936700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0bc420 con 0x7fc004003a00 2023-03-06T14:16:12.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc022936700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c1e07b0 con 0x7fc01c0b94d0 2023-03-06T14:16:12.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc022936700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c1e0a90 con 0x7fc01c14ee50 2023-03-06T14:16:12.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc01bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc004003a00 0x7fc01c1e01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc01bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc004003a00 0x7fc01c1e01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55856/0 (socket says 172.21.15.3:55856) 2023-03-06T14:16:12.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc01bfff700 1 -- 172.21.15.3:0/1348797933 learned_addr learned my addr 172.21.15.3:0/1348797933 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:12.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc01b7fe700 1 --2- 172.21.15.3:0/1348797933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc01c0b94d0 0x7fc01c14e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc020ed3700 1 --2- 172.21.15.3:0/1348797933 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc01c14ee50 0x7fc01c13cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc01bfff700 1 -- 172.21.15.3:0/1348797933 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc01c14ee50 msgr2=0x7fc01c13cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:12.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc01bfff700 1 --2- 172.21.15.3:0/1348797933 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc01c14ee50 0x7fc01c13cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc01bfff700 1 -- 172.21.15.3:0/1348797933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc01c0b94d0 msgr2=0x7fc01c14e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:12.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc01bfff700 1 --2- 172.21.15.3:0/1348797933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc01c0b94d0 0x7fc01c14e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc01bfff700 1 -- 172.21.15.3:0/1348797933 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c0b8b50 con 0x7fc004003a00 2023-03-06T14:16:12.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc01b7fe700 1 --2- 172.21.15.3:0/1348797933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc01c0b94d0 0x7fc01c14e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:12.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc01bfff700 1 --2- 172.21.15.3:0/1348797933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc004003a00 0x7fc01c1e01d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00c0e0 tx=0x7fc00c001280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:12.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc018ff9700 1 -- 172.21.15.3:0/1348797933 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c001320 con 0x7fc004003a00 2023-03-06T14:16:12.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc018ff9700 1 -- 172.21.15.3:0/1348797933 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c00cc90 con 0x7fc004003a00 2023-03-06T14:16:12.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc022936700 1 -- 172.21.15.3:0/1348797933 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01c0b8870 con 0x7fc004003a00 2023-03-06T14:16:12.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc018ff9700 1 -- 172.21.15.3:0/1348797933 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c005070 con 0x7fc004003a00 2023-03-06T14:16:12.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.419+0000 7fc022936700 1 -- 172.21.15.3:0/1348797933 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01c0b7110 con 0x7fc004003a00 2023-03-06T14:16:12.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.420+0000 7fc022936700 1 -- 172.21.15.3:0/1348797933 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01c0c2a30 con 0x7fc004003a00 2023-03-06T14:16:12.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.421+0000 7fc018ff9700 1 -- 172.21.15.3:0/1348797933 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc00c010050 con 0x7fc004003a00 2023-03-06T14:16:12.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.421+0000 7fc018ff9700 1 --2- 172.21.15.3:0/1348797933 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0080682f0 0x7fc00806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.421+0000 7fc018ff9700 1 -- 172.21.15.3:0/1348797933 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc00c087820 con 0x7fc004003a00 2023-03-06T14:16:12.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.421+0000 7fc01b7fe700 1 --2- 172.21.15.3:0/1348797933 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0080682f0 0x7fc00806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.422+0000 7fc01b7fe700 1 --2- 172.21.15.3:0/1348797933 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0080682f0 0x7fc00806a7a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc010000c00 tx=0x7fc010009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:12.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.425+0000 7fc018ff9700 1 -- 172.21.15.3:0/1348797933 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc00c053d30 con 0x7fc004003a00 2023-03-06T14:16:12.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.614+0000 7fc022936700 1 -- 172.21.15.3:0/1348797933 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc01c06f780 con 0x7fc004003a00 2023-03-06T14:16:12.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.615+0000 7fc018ff9700 1 -- 172.21.15.3:0/1348797933 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc00c057350 con 0x7fc004003a00 2023-03-06T14:16:12.616 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-03-06T14:16:12.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.617+0000 7fc022936700 1 -- 172.21.15.3:0/1348797933 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0080682f0 msgr2=0x7fc00806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:12.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.617+0000 7fc022936700 1 --2- 172.21.15.3:0/1348797933 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0080682f0 0x7fc00806a7a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc010000c00 tx=0x7fc010009040 comp rx=0 tx=0).stop 2023-03-06T14:16:12.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.617+0000 7fc022936700 1 -- 172.21.15.3:0/1348797933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc004003a00 msgr2=0x7fc01c1e01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:12.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.617+0000 7fc022936700 1 --2- 172.21.15.3:0/1348797933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc004003a00 0x7fc01c1e01d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00c0e0 tx=0x7fc00c001280 comp rx=0 tx=0).stop 2023-03-06T14:16:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.617+0000 7fc022936700 1 -- 172.21.15.3:0/1348797933 shutdown_connections 2023-03-06T14:16:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.617+0000 7fc022936700 1 --2- 172.21.15.3:0/1348797933 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0080682f0 0x7fc00806a7a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.617+0000 7fc022936700 1 --2- 172.21.15.3:0/1348797933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc004003a00 0x7fc01c1e01d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.617+0000 7fc022936700 1 --2- 172.21.15.3:0/1348797933 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc01c14ee50 0x7fc01c13cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.617+0000 7fc022936700 1 --2- 172.21.15.3:0/1348797933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc01c0b94d0 0x7fc01c14e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.617+0000 7fc022936700 1 -- 172.21.15.3:0/1348797933 >> 172.21.15.3:0/1348797933 conn(0x7fc01c0c2150 msgr2=0x7fc01c14b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.617+0000 7fc022936700 1 -- 172.21.15.3:0/1348797933 shutdown_connections 2023-03-06T14:16:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.617+0000 7fc022936700 1 -- 172.21.15.3:0/1348797933 wait complete. 2023-03-06T14:16:12.630 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-06T14:16:12.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.757+0000 7f2a49b68700 1 Processor -- start 2023-03-06T14:16:12.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.757+0000 7f2a49b68700 1 -- start start 2023-03-06T14:16:12.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.758+0000 7f2a49b68700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2a44146130 0x7f2a4414f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.758+0000 7f2a49b68700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a440b8140 0x7f2a4406e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.758+0000 7f2a49b68700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2a4406edd0 0x7f2a4406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.758+0000 7f2a49b68700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4414fab0 con 0x7f2a4406edd0 2023-03-06T14:16:12.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.758+0000 7f2a49b68700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4406fc80 con 0x7f2a44146130 2023-03-06T14:16:12.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.758+0000 7f2a49b68700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4414cb30 con 0x7f2a440b8140 2023-03-06T14:16:12.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.758+0000 7f2a43fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2a4406edd0 0x7f2a4406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.758+0000 7f2a43fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2a4406edd0 0x7f2a4406bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55868/0 (socket says 172.21.15.3:55868) 2023-03-06T14:16:12.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.758+0000 7f2a43fff700 1 -- 172.21.15.3:0/3260014400 learned_addr learned my addr 172.21.15.3:0/3260014400 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:12.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.758+0000 7f2a42ffd700 1 --2- 172.21.15.3:0/3260014400 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a440b8140 0x7f2a4406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.758+0000 7f2a437fe700 1 --2- 172.21.15.3:0/3260014400 >> v2:172.21.15.136:3300/0 conn(0x7f2a44146130 0x7f2a4414f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.758+0000 7f2a43fff700 1 -- 172.21.15.3:0/3260014400 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a440b8140 msgr2=0x7f2a4406e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:12.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.758+0000 7f2a43fff700 1 --2- 172.21.15.3:0/3260014400 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a440b8140 0x7f2a4406e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.758+0000 7f2a43fff700 1 -- 172.21.15.3:0/3260014400 >> v2:172.21.15.136:3300/0 conn(0x7f2a44146130 msgr2=0x7f2a4414f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:12.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.758+0000 7f2a43fff700 1 --2- 172.21.15.3:0/3260014400 >> v2:172.21.15.136:3300/0 conn(0x7f2a44146130 0x7f2a4414f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.758+0000 7f2a43fff700 1 -- 172.21.15.3:0/3260014400 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4406f520 con 0x7f2a4406edd0 2023-03-06T14:16:12.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.758+0000 7f2a43fff700 1 --2- 172.21.15.3:0/3260014400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a4406edd0 0x7f2a4406bc70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2a440bc7b0 tx=0x7f2a3c00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71673c819bcf7e80 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:12.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.758+0000 7f2a427fc700 1 -- 172.21.15.3:0/3260014400 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c010070 con 0x7f2a4406edd0 2023-03-06T14:16:12.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.759+0000 7f2a427fc700 1 -- 172.21.15.3:0/3260014400 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c00dce0 con 0x7f2a4406edd0 2023-03-06T14:16:12.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.759+0000 7f2a427fc700 1 -- 172.21.15.3:0/3260014400 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c00b310 con 0x7f2a4406edd0 2023-03-06T14:16:12.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.759+0000 7f2a49b68700 1 -- 172.21.15.3:0/3260014400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a4406edd0 msgr2=0x7f2a4406bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:12.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.759+0000 7f2a49b68700 1 --2- 172.21.15.3:0/3260014400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a4406edd0 0x7f2a4406bc70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2a440bc7b0 tx=0x7f2a3c00d430 comp rx=0 tx=0).stop 2023-03-06T14:16:12.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.759+0000 7f2a49b68700 1 -- 172.21.15.3:0/3260014400 shutdown_connections 2023-03-06T14:16:12.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.759+0000 7f2a49b68700 1 --2- 172.21.15.3:0/3260014400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a4406edd0 0x7f2a4406bc70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.759+0000 7f2a49b68700 1 --2- 172.21.15.3:0/3260014400 >> v2:172.21.15.136:3300/0 conn(0x7f2a44146130 0x7f2a4414f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.759+0000 7f2a49b68700 1 --2- 172.21.15.3:0/3260014400 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a440b8140 0x7f2a4406e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.759+0000 7f2a49b68700 1 -- 172.21.15.3:0/3260014400 >> 172.21.15.3:0/3260014400 conn(0x7f2a440c2150 msgr2=0x7f2a440c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:12.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.759+0000 7f2a49b68700 1 -- 172.21.15.3:0/3260014400 shutdown_connections 2023-03-06T14:16:12.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.759+0000 7f2a49b68700 1 -- 172.21.15.3:0/3260014400 wait complete. 2023-03-06T14:16:12.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.760+0000 7f2a49b68700 1 Processor -- start 2023-03-06T14:16:12.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.760+0000 7f2a49b68700 1 -- start start 2023-03-06T14:16:12.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.761+0000 7f2a49b68700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a4406edd0 0x7f2a4409d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.761+0000 7f2a49b68700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a440b8140 0x7f2a440b9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.761+0000 7f2a49b68700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a44146130 0x7f2a440bab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.761+0000 7f2a49b68700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440bc080 con 0x7f2a440b8140 2023-03-06T14:16:12.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.761+0000 7f2a49b68700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440b9aa0 con 0x7f2a44146130 2023-03-06T14:16:12.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.761+0000 7f2a49b68700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440bbb00 con 0x7f2a4406edd0 2023-03-06T14:16:12.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.761+0000 7f2a42ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a440b8140 0x7f2a440b9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.761+0000 7f2a42ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a440b8140 0x7f2a440b9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55872/0 (socket says 172.21.15.3:55872) 2023-03-06T14:16:12.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.761+0000 7f2a42ffd700 1 -- 172.21.15.3:0/3733117070 learned_addr learned my addr 172.21.15.3:0/3733117070 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:12.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.761+0000 7f2a42ffd700 1 -- 172.21.15.3:0/3733117070 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a4406edd0 msgr2=0x7f2a4409d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:12.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.761+0000 7f2a437fe700 1 --2- 172.21.15.3:0/3733117070 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a4406edd0 0x7f2a4409d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.761+0000 7f2a43fff700 1 --2- 172.21.15.3:0/3733117070 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a44146130 0x7f2a440bab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.761+0000 7f2a42ffd700 1 --2- 172.21.15.3:0/3733117070 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a4406edd0 0x7f2a4409d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.761+0000 7f2a42ffd700 1 -- 172.21.15.3:0/3733117070 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a44146130 msgr2=0x7f2a440bab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:12.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.761+0000 7f2a42ffd700 1 --2- 172.21.15.3:0/3733117070 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a44146130 0x7f2a440bab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.761+0000 7f2a42ffd700 1 -- 172.21.15.3:0/3733117070 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c00bd40 con 0x7f2a440b8140 2023-03-06T14:16:12.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.762+0000 7f2a42ffd700 1 --2- 172.21.15.3:0/3733117070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a440b8140 0x7f2a440b9560 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400e930 tx=0x7f2a3400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:12.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.762+0000 7f2a2bfff700 1 -- 172.21.15.3:0/3733117070 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34009690 con 0x7f2a440b8140 2023-03-06T14:16:12.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.762+0000 7f2a2bfff700 1 -- 172.21.15.3:0/3733117070 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3400c850 con 0x7f2a440b8140 2023-03-06T14:16:12.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.762+0000 7f2a49b68700 1 -- 172.21.15.3:0/3733117070 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a440b8870 con 0x7f2a440b8140 2023-03-06T14:16:12.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.762+0000 7f2a2bfff700 1 -- 172.21.15.3:0/3733117070 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400cbe0 con 0x7f2a440b8140 2023-03-06T14:16:12.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.762+0000 7f2a49b68700 1 -- 172.21.15.3:0/3733117070 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4406f9a0 con 0x7f2a440b8140 2023-03-06T14:16:12.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.763+0000 7f2a49b68700 1 -- 172.21.15.3:0/3733117070 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a440b8b50 con 0x7f2a440b8140 2023-03-06T14:16:12.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.763+0000 7f2a2bfff700 1 -- 172.21.15.3:0/3733117070 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2a34019030 con 0x7f2a440b8140 2023-03-06T14:16:12.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.764+0000 7f2a2bfff700 1 --2- 172.21.15.3:0/3733117070 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f2a300682f0 0x7f2a3006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:12.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.764+0000 7f2a2bfff700 1 -- 172.21.15.3:0/3733117070 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2a34085f40 con 0x7f2a440b8140 2023-03-06T14:16:12.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.764+0000 7f2a437fe700 1 --2- 172.21.15.3:0/3733117070 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f2a300682f0 0x7f2a3006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:12.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.764+0000 7f2a437fe700 1 --2- 172.21.15.3:0/3733117070 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f2a300682f0 0x7f2a3006a7a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2a4406d030 tx=0x7f2a38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:12.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.768+0000 7f2a2bfff700 1 -- 172.21.15.3:0/3733117070 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2a34052450 con 0x7f2a440b8140 2023-03-06T14:16:12.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.961+0000 7f2a49b68700 1 -- 172.21.15.3:0/3733117070 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a440bcbf0 con 0x7f2a440b8140 2023-03-06T14:16:12.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.961+0000 7f2a2bfff700 1 -- 172.21.15.3:0/3733117070 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a34017020 con 0x7f2a440b8140 2023-03-06T14:16:12.963 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-03-06T14:16:12.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.963+0000 7f2a49b68700 1 -- 172.21.15.3:0/3733117070 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f2a300682f0 msgr2=0x7f2a3006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:12.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.963+0000 7f2a49b68700 1 --2- 172.21.15.3:0/3733117070 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f2a300682f0 0x7f2a3006a7a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2a4406d030 tx=0x7f2a38008040 comp rx=0 tx=0).stop 2023-03-06T14:16:12.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.963+0000 7f2a49b68700 1 -- 172.21.15.3:0/3733117070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a440b8140 msgr2=0x7f2a440b9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:12.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.963+0000 7f2a49b68700 1 --2- 172.21.15.3:0/3733117070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a440b8140 0x7f2a440b9560 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400e930 tx=0x7f2a3400ecf0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.963+0000 7f2a49b68700 1 -- 172.21.15.3:0/3733117070 shutdown_connections 2023-03-06T14:16:12.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.963+0000 7f2a49b68700 1 --2- 172.21.15.3:0/3733117070 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f2a300682f0 0x7f2a3006a7a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.963+0000 7f2a49b68700 1 --2- 172.21.15.3:0/3733117070 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a44146130 0x7f2a440bab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.963+0000 7f2a49b68700 1 --2- 172.21.15.3:0/3733117070 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a4406edd0 0x7f2a4409d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.963+0000 7f2a49b68700 1 --2- 172.21.15.3:0/3733117070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a440b8140 0x7f2a440b9560 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:12.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.963+0000 7f2a49b68700 1 -- 172.21.15.3:0/3733117070 >> 172.21.15.3:0/3733117070 conn(0x7f2a440c2150 msgr2=0x7f2a4414f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:12.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.963+0000 7f2a49b68700 1 -- 172.21.15.3:0/3733117070 shutdown_connections 2023-03-06T14:16:12.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:12.963+0000 7f2a49b68700 1 -- 172.21.15.3:0/3733117070 wait complete. 2023-03-06T14:16:12.976 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-06T14:16:13.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.102+0000 7f28d6b46700 1 Processor -- start 2023-03-06T14:16:13.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.102+0000 7f28d6b46700 1 -- start start 2023-03-06T14:16:13.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.103+0000 7f28d6b46700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f28d006ee40 0x7f28d00bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:13.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.103+0000 7f28d6b46700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d00bdd60 0x7f28d006c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:13.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.103+0000 7f28d6b46700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d014ff80 con 0x7f28d006ea70 2023-03-06T14:16:13.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.103+0000 7f28d6b46700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d00b9070 con 0x7f28d006ee40 2023-03-06T14:16:13.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.103+0000 7f28d6b46700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00bcb90 con 0x7f28d00bdd60 2023-03-06T14:16:13.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.103+0000 7f28d50e3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d00bdd60 0x7f28d006c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:13.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.103+0000 7f28cffff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f28d006ee40 0x7f28d00bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:13.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.104+0000 7f28d50e3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d00bdd60 0x7f28d006c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.3:48862/0 (socket says 172.21.15.3:48862) 2023-03-06T14:16:13.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.104+0000 7f28d48e2700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f28d006ea70 0x7f28d01490f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.3:55636/0 (socket says 172.21.15.3:55636) 2023-03-06T14:16:13.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.104+0000 7f28d50e3700 1 -- 172.21.15.3:0/80776304 learned_addr learned my addr 172.21.15.3:0/80776304 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:13.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.104+0000 7f28cffff700 1 -- 172.21.15.3:0/80776304 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d00bdd60 msgr2=0x7f28d006c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:13.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.104+0000 7f28cffff700 1 --2- 172.21.15.3:0/80776304 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d00bdd60 0x7f28d006c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.104+0000 7f28cffff700 1 -- 172.21.15.3:0/80776304 >> v1:172.21.15.136:6789/0 conn(0x7f28d006ea70 legacy=0x7f28d01490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:13.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.104+0000 7f28cffff700 1 -- 172.21.15.3:0/80776304 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d00bce70 con 0x7f28d006ee40 2023-03-06T14:16:13.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.104+0000 7f28cffff700 1 --2- 172.21.15.3:0/80776304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28d006ee40 0x7f28d00bd670 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f28bc009840 tx=0x7f28bc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7a3f79cbd1e5811 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:13.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.104+0000 7f28cf7fe700 1 -- 172.21.15.3:0/80776304 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc011830 con 0x7f28d006ee40 2023-03-06T14:16:13.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.104+0000 7f28cf7fe700 1 -- 172.21.15.3:0/80776304 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc011990 con 0x7f28d006ee40 2023-03-06T14:16:13.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.104+0000 7f28cf7fe700 1 -- 172.21.15.3:0/80776304 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc011d20 con 0x7f28d006ee40 2023-03-06T14:16:13.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.105+0000 7f28d6b46700 1 -- 172.21.15.3:0/80776304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28d006ee40 msgr2=0x7f28d00bd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:13.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.105+0000 7f28d6b46700 1 --2- 172.21.15.3:0/80776304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28d006ee40 0x7f28d00bd670 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f28bc009840 tx=0x7f28bc009b50 comp rx=0 tx=0).stop 2023-03-06T14:16:13.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.105+0000 7f28d6b46700 1 -- 172.21.15.3:0/80776304 shutdown_connections 2023-03-06T14:16:13.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.105+0000 7f28d6b46700 1 --2- 172.21.15.3:0/80776304 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d00bdd60 0x7f28d006c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.105+0000 7f28d6b46700 1 --2- 172.21.15.3:0/80776304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28d006ee40 0x7f28d00bd670 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.105+0000 7f28d6b46700 1 -- 172.21.15.3:0/80776304 >> 172.21.15.3:0/80776304 conn(0x7f28d00c2150 msgr2=0x7f28d00c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:13.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.105+0000 7f28d6b46700 1 -- 172.21.15.3:0/80776304 shutdown_connections 2023-03-06T14:16:13.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.105+0000 7f28d6b46700 1 -- 172.21.15.3:0/80776304 wait complete. 2023-03-06T14:16:13.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.106+0000 7f28d6b46700 1 Processor -- start 2023-03-06T14:16:13.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.106+0000 7f28d6b46700 1 -- start start 2023-03-06T14:16:13.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.107+0000 7f28d6b46700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d006ea70 0x7f28d01e7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:13.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.107+0000 7f28d6b46700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28d006ee40 0x7f28d01e7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:13.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.107+0000 7f28d6b46700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f28d00bdd60 0x7f28d01504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:13.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.107+0000 7f28d6b46700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00b9e40 con 0x7f28d00bdd60 2023-03-06T14:16:13.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.107+0000 7f28d6b46700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00c06d0 con 0x7f28d006ee40 2023-03-06T14:16:13.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.107+0000 7f28d6b46700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00ba090 con 0x7f28d006ea70 2023-03-06T14:16:13.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.107+0000 7f28d50e3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f28d00bdd60 0x7f28d01504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:13.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.107+0000 7f28d50e3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f28d00bdd60 0x7f28d01504c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55888/0 (socket says 172.21.15.3:55888) 2023-03-06T14:16:13.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.107+0000 7f28d50e3700 1 -- 172.21.15.3:0/1871970582 learned_addr learned my addr 172.21.15.3:0/1871970582 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:13.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.107+0000 7f28d48e2700 1 --2- 172.21.15.3:0/1871970582 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d006ea70 0x7f28d01e7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:13.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.107+0000 7f28cffff700 1 --2- 172.21.15.3:0/1871970582 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28d006ee40 0x7f28d01e7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:13.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.107+0000 7f28d50e3700 1 -- 172.21.15.3:0/1871970582 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d006ea70 msgr2=0x7f28d01e7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:13.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.107+0000 7f28d50e3700 1 --2- 172.21.15.3:0/1871970582 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d006ea70 0x7f28d01e7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.107+0000 7f28d50e3700 1 -- 172.21.15.3:0/1871970582 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28d006ee40 msgr2=0x7f28d01e7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:13.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.107+0000 7f28d50e3700 1 --2- 172.21.15.3:0/1871970582 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28d006ee40 0x7f28d01e7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.107+0000 7f28d50e3700 1 -- 172.21.15.3:0/1871970582 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc0094a0 con 0x7f28d00bdd60 2023-03-06T14:16:13.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.107+0000 7f28d50e3700 1 --2- 172.21.15.3:0/1871970582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f28d00bdd60 0x7f28d01504c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f28c800ec10 tx=0x7f28c800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:13.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.108+0000 7f28cd7fa700 1 -- 172.21.15.3:0/1871970582 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c8003c20 con 0x7f28d00bdd60 2023-03-06T14:16:13.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.108+0000 7f28cd7fa700 1 -- 172.21.15.3:0/1871970582 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c800f040 con 0x7f28d00bdd60 2023-03-06T14:16:13.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.108+0000 7f28d6b46700 1 -- 172.21.15.3:0/1871970582 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d0150220 con 0x7f28d00bdd60 2023-03-06T14:16:13.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.108+0000 7f28cd7fa700 1 -- 172.21.15.3:0/1871970582 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c800c740 con 0x7f28d00bdd60 2023-03-06T14:16:13.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.108+0000 7f28d6b46700 1 -- 172.21.15.3:0/1871970582 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d00bd150 con 0x7f28d00bdd60 2023-03-06T14:16:13.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.109+0000 7f28d6b46700 1 -- 172.21.15.3:0/1871970582 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d00b8b80 con 0x7f28d00bdd60 2023-03-06T14:16:13.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.109+0000 7f28cd7fa700 1 -- 172.21.15.3:0/1871970582 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f28c800c8a0 con 0x7f28d00bdd60 2023-03-06T14:16:13.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.109+0000 7f28cd7fa700 1 --2- 172.21.15.3:0/1871970582 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f28b40682f0 0x7f28b406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:13.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.110+0000 7f28cd7fa700 1 -- 172.21.15.3:0/1871970582 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f28c8086390 con 0x7f28d00bdd60 2023-03-06T14:16:13.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.110+0000 7f28d48e2700 1 --2- 172.21.15.3:0/1871970582 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f28b40682f0 0x7f28b406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:13.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.110+0000 7f28d48e2700 1 --2- 172.21.15.3:0/1871970582 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f28b40682f0 0x7f28b406a7a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f28c4000fb0 tx=0x7f28c4007ce0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:13.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.114+0000 7f28cd7fa700 1 -- 172.21.15.3:0/1871970582 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f28c80528a0 con 0x7f28d00bdd60 2023-03-06T14:16:13.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.308+0000 7f28d6b46700 1 -- 172.21.15.3:0/1871970582 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28d00bc2f0 con 0x7f28d00bdd60 2023-03-06T14:16:13.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.309+0000 7f28cd7fa700 1 -- 172.21.15.3:0/1871970582 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28c8055ec0 con 0x7f28d00bdd60 2023-03-06T14:16:13.310 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-03-06T14:16:13.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.311+0000 7f28d6b46700 1 -- 172.21.15.3:0/1871970582 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f28b40682f0 msgr2=0x7f28b406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:13.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.311+0000 7f28d6b46700 1 --2- 172.21.15.3:0/1871970582 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f28b40682f0 0x7f28b406a7a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f28c4000fb0 tx=0x7f28c4007ce0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.311+0000 7f28d6b46700 1 -- 172.21.15.3:0/1871970582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f28d00bdd60 msgr2=0x7f28d01504c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:13.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.311+0000 7f28d6b46700 1 --2- 172.21.15.3:0/1871970582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f28d00bdd60 0x7f28d01504c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f28c800ec10 tx=0x7f28c800c0c0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.311+0000 7f28d6b46700 1 -- 172.21.15.3:0/1871970582 shutdown_connections 2023-03-06T14:16:13.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.311+0000 7f28d6b46700 1 --2- 172.21.15.3:0/1871970582 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f28b40682f0 0x7f28b406a7a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.311+0000 7f28d6b46700 1 --2- 172.21.15.3:0/1871970582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f28d00bdd60 0x7f28d01504c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.311+0000 7f28d6b46700 1 --2- 172.21.15.3:0/1871970582 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d006ea70 0x7f28d01e7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.311+0000 7f28d6b46700 1 --2- 172.21.15.3:0/1871970582 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28d006ee40 0x7f28d01e7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.311+0000 7f28d6b46700 1 -- 172.21.15.3:0/1871970582 >> 172.21.15.3:0/1871970582 conn(0x7f28d00c2150 msgr2=0x7f28d00c0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:13.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.311+0000 7f28d6b46700 1 -- 172.21.15.3:0/1871970582 shutdown_connections 2023-03-06T14:16:13.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.311+0000 7f28d6b46700 1 -- 172.21.15.3:0/1871970582 wait complete. 2023-03-06T14:16:13.324 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-06T14:16:13.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.450+0000 7ff006100700 1 Processor -- start 2023-03-06T14:16:13.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.450+0000 7ff006100700 1 -- start start 2023-03-06T14:16:13.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.451+0000 7ff006100700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff0000b8140 0x7ff00006e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:13.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.451+0000 7ff006100700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00006edd0 0x7ff000156900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:13.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.451+0000 7ff006100700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff00006fc80 con 0x7ff000146130 2023-03-06T14:16:13.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.451+0000 7ff006100700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff00014cb30 con 0x7ff0000b8140 2023-03-06T14:16:13.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.451+0000 7ff006100700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00006f520 con 0x7ff00006edd0 2023-03-06T14:16:13.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.451+0000 7fefff7fe700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7ff000146130 0x7ff00014f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.3:55650/0 (socket says 172.21.15.3:55650) 2023-03-06T14:16:13.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.451+0000 7feffffff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00006edd0 0x7ff000156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:13.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.451+0000 7fefff7fe700 1 -- 172.21.15.3:0/2199350625 learned_addr learned my addr 172.21.15.3:0/2199350625 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:13.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.451+0000 7feffeffd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff0000b8140 0x7ff00006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:13.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.452+0000 7feffe7fc700 1 -- 172.21.15.3:0/2199350625 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183840917 0 0) 0x7ff00006fc80 con 0x7ff000146130 2023-03-06T14:16:13.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.452+0000 7feffe7fc700 1 -- 172.21.15.3:0/2199350625 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefe80035b0 con 0x7ff000146130 2023-03-06T14:16:13.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.452+0000 7feffeffd700 1 -- 172.21.15.3:0/2199350625 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00006edd0 msgr2=0x7ff000156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:13.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.452+0000 7feffeffd700 1 --2- 172.21.15.3:0/2199350625 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00006edd0 0x7ff000156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.452+0000 7feffeffd700 1 -- 172.21.15.3:0/2199350625 >> v1:172.21.15.136:6789/0 conn(0x7ff000146130 legacy=0x7ff00014f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:13.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.452+0000 7feffeffd700 1 -- 172.21.15.3:0/2199350625 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00006f9a0 con 0x7ff0000b8140 2023-03-06T14:16:13.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.452+0000 7feffffff700 1 --2- 172.21.15.3:0/2199350625 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00006edd0 0x7ff000156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:16:13.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.452+0000 7feffeffd700 1 --2- 172.21.15.3:0/2199350625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0000b8140 0x7ff00006e890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feff4009840 tx=0x7feff4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41f768fbac3e5576 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:13.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.452+0000 7feffe7fc700 1 -- 172.21.15.3:0/2199350625 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4011830 con 0x7ff0000b8140 2023-03-06T14:16:13.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.452+0000 7feffe7fc700 1 -- 172.21.15.3:0/2199350625 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff4011990 con 0x7ff0000b8140 2023-03-06T14:16:13.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.452+0000 7feffe7fc700 1 -- 172.21.15.3:0/2199350625 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4011d20 con 0x7ff0000b8140 2023-03-06T14:16:13.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.453+0000 7ff006100700 1 -- 172.21.15.3:0/2199350625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0000b8140 msgr2=0x7ff00006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:13.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.453+0000 7ff006100700 1 --2- 172.21.15.3:0/2199350625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0000b8140 0x7ff00006e890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feff4009840 tx=0x7feff4009b50 comp rx=0 tx=0).stop 2023-03-06T14:16:13.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.453+0000 7ff006100700 1 -- 172.21.15.3:0/2199350625 shutdown_connections 2023-03-06T14:16:13.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.453+0000 7ff006100700 1 --2- 172.21.15.3:0/2199350625 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00006edd0 0x7ff000156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.453+0000 7ff006100700 1 --2- 172.21.15.3:0/2199350625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0000b8140 0x7ff00006e890 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.453+0000 7ff006100700 1 -- 172.21.15.3:0/2199350625 >> 172.21.15.3:0/2199350625 conn(0x7ff0000c2150 msgr2=0x7ff0000c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:13.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.453+0000 7ff006100700 1 -- 172.21.15.3:0/2199350625 shutdown_connections 2023-03-06T14:16:13.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.453+0000 7ff006100700 1 -- 172.21.15.3:0/2199350625 wait complete. 2023-03-06T14:16:13.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.454+0000 7ff006100700 1 Processor -- start 2023-03-06T14:16:13.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.454+0000 7ff006100700 1 -- start start 2023-03-06T14:16:13.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.455+0000 7ff006100700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00006edd0 0x7ff0001406f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:13.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.455+0000 7ff006100700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0000b8140 0x7ff00013e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:13.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.455+0000 7ff006100700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff000146130 0x7ff00013ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:13.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.455+0000 7ff006100700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0001ddd60 con 0x7ff000146130 2023-03-06T14:16:13.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.455+0000 7ff006100700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff000140c30 con 0x7ff0000b8140 2023-03-06T14:16:13.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.455+0000 7ff006100700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0001411e0 con 0x7ff00006edd0 2023-03-06T14:16:13.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.455+0000 7feffffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff000146130 0x7ff00013ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:13.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.455+0000 7feffffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff000146130 0x7ff00013ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55902/0 (socket says 172.21.15.3:55902) 2023-03-06T14:16:13.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.455+0000 7feffffff700 1 -- 172.21.15.3:0/2912324423 learned_addr learned my addr 172.21.15.3:0/2912324423 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:13.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.455+0000 7feffeffd700 1 --2- 172.21.15.3:0/2912324423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0000b8140 0x7ff00013e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:13.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.455+0000 7fefff7fe700 1 --2- 172.21.15.3:0/2912324423 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00006edd0 0x7ff0001406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:13.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.455+0000 7feffffff700 1 -- 172.21.15.3:0/2912324423 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00006edd0 msgr2=0x7ff0001406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:13.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.455+0000 7feffffff700 1 --2- 172.21.15.3:0/2912324423 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00006edd0 0x7ff0001406f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.455+0000 7feffffff700 1 -- 172.21.15.3:0/2912324423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0000b8140 msgr2=0x7ff00013e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:13.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.455+0000 7feffffff700 1 --2- 172.21.15.3:0/2912324423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0000b8140 0x7ff00013e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.455+0000 7feffffff700 1 -- 172.21.15.3:0/2912324423 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff8009a70 con 0x7ff000146130 2023-03-06T14:16:13.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.456+0000 7feffffff700 1 --2- 172.21.15.3:0/2912324423 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff000146130 0x7ff00013ea90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7feff8009f00 tx=0x7feff800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:13.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.456+0000 7fefe7fff700 1 -- 172.21.15.3:0/2912324423 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff8009d70 con 0x7ff000146130 2023-03-06T14:16:13.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.456+0000 7fefe7fff700 1 -- 172.21.15.3:0/2912324423 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff800f040 con 0x7ff000146130 2023-03-06T14:16:13.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.456+0000 7ff006100700 1 -- 172.21.15.3:0/2912324423 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff40094a0 con 0x7ff000146130 2023-03-06T14:16:13.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.456+0000 7fefe7fff700 1 -- 172.21.15.3:0/2912324423 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff800cd70 con 0x7ff000146130 2023-03-06T14:16:13.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.456+0000 7ff006100700 1 -- 172.21.15.3:0/2912324423 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0000b8b50 con 0x7ff000146130 2023-03-06T14:16:13.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.457+0000 7ff006100700 1 -- 172.21.15.3:0/2912324423 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0000b8870 con 0x7ff000146130 2023-03-06T14:16:13.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.457+0000 7fefe7fff700 1 -- 172.21.15.3:0/2912324423 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7feff8014480 con 0x7ff000146130 2023-03-06T14:16:13.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.457+0000 7fefe7fff700 1 --2- 172.21.15.3:0/2912324423 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fefec0682f0 0x7fefec06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:13.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.458+0000 7fefe7fff700 1 -- 172.21.15.3:0/2912324423 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feff80866d0 con 0x7ff000146130 2023-03-06T14:16:13.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.458+0000 7fefff7fe700 1 --2- 172.21.15.3:0/2912324423 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fefec0682f0 0x7fefec06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:13.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.458+0000 7fefff7fe700 1 --2- 172.21.15.3:0/2912324423 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fefec0682f0 0x7fefec06a7a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feff0001230 tx=0x7feff0007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:13.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.462+0000 7fefe7fff700 1 -- 172.21.15.3:0/2912324423 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7feff8052be0 con 0x7ff000146130 2023-03-06T14:16:13.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.656+0000 7ff006100700 1 -- 172.21.15.3:0/2912324423 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff0000b7110 con 0x7ff000146130 2023-03-06T14:16:13.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.656+0000 7fefe7fff700 1 -- 172.21.15.3:0/2912324423 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7feff8056200 con 0x7ff000146130 2023-03-06T14:16:13.658 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-03-06T14:16:13.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.658+0000 7ff006100700 1 -- 172.21.15.3:0/2912324423 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fefec0682f0 msgr2=0x7fefec06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:13.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.658+0000 7ff006100700 1 --2- 172.21.15.3:0/2912324423 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fefec0682f0 0x7fefec06a7a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feff0001230 tx=0x7feff0007df0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.658+0000 7ff006100700 1 -- 172.21.15.3:0/2912324423 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff000146130 msgr2=0x7ff00013ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:13.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.658+0000 7ff006100700 1 --2- 172.21.15.3:0/2912324423 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff000146130 0x7ff00013ea90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7feff8009f00 tx=0x7feff800c3a0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.658+0000 7ff006100700 1 -- 172.21.15.3:0/2912324423 shutdown_connections 2023-03-06T14:16:13.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.658+0000 7ff006100700 1 --2- 172.21.15.3:0/2912324423 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fefec0682f0 0x7fefec06a7a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.658+0000 7ff006100700 1 --2- 172.21.15.3:0/2912324423 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff000146130 0x7ff00013ea90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.658+0000 7ff006100700 1 --2- 172.21.15.3:0/2912324423 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00006edd0 0x7ff0001406f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.658+0000 7ff006100700 1 --2- 172.21.15.3:0/2912324423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0000b8140 0x7ff00013e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.658+0000 7ff006100700 1 -- 172.21.15.3:0/2912324423 >> 172.21.15.3:0/2912324423 conn(0x7ff0000c2150 msgr2=0x7ff000141550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:13.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.658+0000 7ff006100700 1 -- 172.21.15.3:0/2912324423 shutdown_connections 2023-03-06T14:16:13.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.658+0000 7ff006100700 1 -- 172.21.15.3:0/2912324423 wait complete. 2023-03-06T14:16:13.671 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-06T14:16:13.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.795+0000 7f779b35c700 1 Processor -- start 2023-03-06T14:16:13.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.795+0000 7f779b35c700 1 -- start start 2023-03-06T14:16:13.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.796+0000 7f779b35c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f779406ee40 0x7f77940bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:13.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.796+0000 7f779b35c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f77940bdd60 0x7f779406c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:13.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.796+0000 7f779b35c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779414ff80 con 0x7f779406ea70 2023-03-06T14:16:13.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.796+0000 7f779b35c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77940b9070 con 0x7f779406ee40 2023-03-06T14:16:13.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.796+0000 7f779b35c700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77940bcb90 con 0x7f77940bdd60 2023-03-06T14:16:13.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.796+0000 7f77988f7700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f779406ee40 0x7f77940bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:13.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.796+0000 7f77990f8700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f779406ea70 0x7f77941490f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58178/0 (socket says 172.21.15.3:58178) 2023-03-06T14:16:13.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.796+0000 7f77990f8700 1 -- 172.21.15.3:0/3314963334 learned_addr learned my addr 172.21.15.3:0/3314963334 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:13.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.797+0000 7f77998f9700 1 --2- 172.21.15.3:0/3314963334 >> v2:172.21.15.136:3300/0 conn(0x7f77940bdd60 0x7f779406c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:13.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.797+0000 7f77988f7700 1 -- 172.21.15.3:0/3314963334 >> v2:172.21.15.136:3300/0 conn(0x7f77940bdd60 msgr2=0x7f779406c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:13.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.797+0000 7f77988f7700 1 --2- 172.21.15.3:0/3314963334 >> v2:172.21.15.136:3300/0 conn(0x7f77940bdd60 0x7f779406c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.797+0000 7f77988f7700 1 -- 172.21.15.3:0/3314963334 >> v1:172.21.15.3:6789/0 conn(0x7f779406ea70 legacy=0x7f77941490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:13.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.797+0000 7f77988f7700 1 -- 172.21.15.3:0/3314963334 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77940bce70 con 0x7f779406ee40 2023-03-06T14:16:13.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.797+0000 7f77988f7700 1 --2- 172.21.15.3:0/3314963334 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779406ee40 0x7f77940bd670 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7794153890 tx=0x7f7790009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc00e87bef3e0997 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:13.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.797+0000 7f778bfff700 1 -- 172.21.15.3:0/3314963334 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7790011830 con 0x7f779406ee40 2023-03-06T14:16:13.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.797+0000 7f778bfff700 1 -- 172.21.15.3:0/3314963334 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7790011990 con 0x7f779406ee40 2023-03-06T14:16:13.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.797+0000 7f778bfff700 1 -- 172.21.15.3:0/3314963334 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7790011d20 con 0x7f779406ee40 2023-03-06T14:16:13.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.797+0000 7f779b35c700 1 -- 172.21.15.3:0/3314963334 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779406ee40 msgr2=0x7f77940bd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:13.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.797+0000 7f779b35c700 1 --2- 172.21.15.3:0/3314963334 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779406ee40 0x7f77940bd670 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7794153890 tx=0x7f7790009b20 comp rx=0 tx=0).stop 2023-03-06T14:16:13.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.797+0000 7f779b35c700 1 -- 172.21.15.3:0/3314963334 shutdown_connections 2023-03-06T14:16:13.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.797+0000 7f779b35c700 1 --2- 172.21.15.3:0/3314963334 >> v2:172.21.15.136:3300/0 conn(0x7f77940bdd60 0x7f779406c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.797+0000 7f779b35c700 1 --2- 172.21.15.3:0/3314963334 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779406ee40 0x7f77940bd670 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.797+0000 7f779b35c700 1 -- 172.21.15.3:0/3314963334 >> 172.21.15.3:0/3314963334 conn(0x7f77940c2150 msgr2=0x7f77940c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:13.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.798+0000 7f779b35c700 1 -- 172.21.15.3:0/3314963334 shutdown_connections 2023-03-06T14:16:13.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.798+0000 7f779b35c700 1 -- 172.21.15.3:0/3314963334 wait complete. 2023-03-06T14:16:13.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.799+0000 7f779b35c700 1 Processor -- start 2023-03-06T14:16:13.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.799+0000 7f779b35c700 1 -- start start 2023-03-06T14:16:13.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.799+0000 7f779b35c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779406ea70 0x7f779414c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:13.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.799+0000 7f779b35c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779406ee40 0x7f77940bbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:13.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.799+0000 7f779b35c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77940bdd60 0x7f779414aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:13.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.799+0000 7f779b35c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7794149ae0 con 0x7f779406ee40 2023-03-06T14:16:13.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.799+0000 7f779b35c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779414a660 con 0x7f77940bdd60 2023-03-06T14:16:13.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.799+0000 7f779b35c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7794149d30 con 0x7f779406ea70 2023-03-06T14:16:13.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.800+0000 7f77988f7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779406ee40 0x7f77940bbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:13.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.800+0000 7f77988f7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779406ee40 0x7f77940bbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55914/0 (socket says 172.21.15.3:55914) 2023-03-06T14:16:13.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.800+0000 7f77988f7700 1 -- 172.21.15.3:0/4213591393 learned_addr learned my addr 172.21.15.3:0/4213591393 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:13.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.800+0000 7f77998f9700 1 --2- 172.21.15.3:0/4213591393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77940bdd60 0x7f779414aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:13.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.800+0000 7f77990f8700 1 --2- 172.21.15.3:0/4213591393 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779406ea70 0x7f779414c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:13.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.800+0000 7f77988f7700 1 -- 172.21.15.3:0/4213591393 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779406ea70 msgr2=0x7f779414c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:13.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.800+0000 7f77988f7700 1 --2- 172.21.15.3:0/4213591393 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779406ea70 0x7f779414c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.800+0000 7f77988f7700 1 -- 172.21.15.3:0/4213591393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77940bdd60 msgr2=0x7f779414aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:13.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.800+0000 7f77988f7700 1 --2- 172.21.15.3:0/4213591393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77940bdd60 0x7f779414aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:13.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.800+0000 7f77988f7700 1 -- 172.21.15.3:0/4213591393 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77900094a0 con 0x7f779406ee40 2023-03-06T14:16:13.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.800+0000 7f77988f7700 1 --2- 172.21.15.3:0/4213591393 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779406ee40 0x7f77940bbca0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f77900090b0 tx=0x7f7790004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:13.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.800+0000 7f7789ffb700 1 -- 172.21.15.3:0/4213591393 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77900036a0 con 0x7f779406ee40 2023-03-06T14:16:13.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.800+0000 7f7789ffb700 1 -- 172.21.15.3:0/4213591393 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779001f070 con 0x7f779406ee40 2023-03-06T14:16:13.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.800+0000 7f7789ffb700 1 -- 172.21.15.3:0/4213591393 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7790003a60 con 0x7f779406ee40 2023-03-06T14:16:13.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.800+0000 7f779b35c700 1 -- 172.21.15.3:0/4213591393 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7794150220 con 0x7f779406ee40 2023-03-06T14:16:13.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.801+0000 7f779b35c700 1 -- 172.21.15.3:0/4213591393 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77940bd150 con 0x7f779406ee40 2023-03-06T14:16:13.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.801+0000 7f779b35c700 1 -- 172.21.15.3:0/4213591393 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77940b8b80 con 0x7f779406ee40 2023-03-06T14:16:13.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.802+0000 7f7789ffb700 1 -- 172.21.15.3:0/4213591393 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f779000f050 con 0x7f779406ee40 2023-03-06T14:16:13.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.802+0000 7f7789ffb700 1 --2- 172.21.15.3:0/4213591393 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f77780682f0 0x7f777806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:13.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.802+0000 7f7789ffb700 1 -- 172.21.15.3:0/4213591393 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7790021070 con 0x7f779406ee40 2023-03-06T14:16:13.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.802+0000 7f77990f8700 1 --2- 172.21.15.3:0/4213591393 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f77780682f0 0x7f777806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:13.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.803+0000 7f77990f8700 1 --2- 172.21.15.3:0/4213591393 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f77780682f0 0x7f777806a7a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7784007fd0 tx=0x7f7784009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:13.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:13.806+0000 7f7789ffb700 1 -- 172.21.15.3:0/4213591393 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7790053df0 con 0x7f779406ee40 2023-03-06T14:16:14.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.014+0000 7f779b35c700 1 -- 172.21.15.3:0/4213591393 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7794149e70 con 0x7f779406ee40 2023-03-06T14:16:14.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.015+0000 7f7789ffb700 1 -- 172.21.15.3:0/4213591393 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7794149e70 con 0x7f779406ee40 2023-03-06T14:16:14.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.016+0000 7f779b35c700 1 -- 172.21.15.3:0/4213591393 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f77780682f0 msgr2=0x7f777806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:14.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.017+0000 7f779b35c700 1 --2- 172.21.15.3:0/4213591393 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f77780682f0 0x7f777806a7a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7784007fd0 tx=0x7f7784009040 comp rx=0 tx=0).stop 2023-03-06T14:16:14.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.017+0000 7f779b35c700 1 -- 172.21.15.3:0/4213591393 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779406ee40 msgr2=0x7f77940bbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:14.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.017+0000 7f779b35c700 1 --2- 172.21.15.3:0/4213591393 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779406ee40 0x7f77940bbca0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f77900090b0 tx=0x7f7790004750 comp rx=0 tx=0).stop 2023-03-06T14:16:14.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.017+0000 7f779b35c700 1 -- 172.21.15.3:0/4213591393 shutdown_connections 2023-03-06T14:16:14.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.017+0000 7f779b35c700 1 --2- 172.21.15.3:0/4213591393 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f77780682f0 0x7f777806a7a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.017+0000 7f779b35c700 1 --2- 172.21.15.3:0/4213591393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77940bdd60 0x7f779414aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.017+0000 7f779b35c700 1 --2- 172.21.15.3:0/4213591393 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779406ea70 0x7f779414c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.017+0000 7f779b35c700 1 --2- 172.21.15.3:0/4213591393 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779406ee40 0x7f77940bbca0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.017+0000 7f779b35c700 1 -- 172.21.15.3:0/4213591393 >> 172.21.15.3:0/4213591393 conn(0x7f77940c2150 msgr2=0x7f77940c0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:14.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.017+0000 7f779b35c700 1 -- 172.21.15.3:0/4213591393 shutdown_connections 2023-03-06T14:16:14.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.017+0000 7f779b35c700 1 -- 172.21.15.3:0/4213591393 wait complete. 2023-03-06T14:16:14.020 INFO:teuthology.orchestra.run.smithi003.stderr:listed 0 entries 2023-03-06T14:16:14.030 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi003.front.sepia.ceph.com... 2023-03-06T14:16:14.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:14.031 DEBUG:teuthology.orchestra.run.smithi003:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-03-06T14:16:14.063 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi003.stderr:ceph-fuse[104663]: fuse finished with error 0 and tester_r 0 2023-03-06T14:16:14.064 INFO:teuthology.orchestra.run:waiting for 300 2023-03-06T14:16:14.088 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi003.front.sepia.ceph.com 2023-03-06T14:16:14.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:14.089 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-03-06T14:16:14.158 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T14:16:14.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.320+0000 7f992c942700 1 Processor -- start 2023-03-06T14:16:14.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.320+0000 7f992c942700 1 -- start start 2023-03-06T14:16:14.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.321+0000 7f992c942700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f992806ea70 0x7f99280bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:14.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.321+0000 7f992c942700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f992806ee40 0x7f99281490f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:14.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.321+0000 7f992c942700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f99280bdd60 0x7f9928149630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:14.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.321+0000 7f992c942700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99280b9070 con 0x7f992806ea70 2023-03-06T14:16:14.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.321+0000 7f992c942700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9928149b70 con 0x7f992806ee40 2023-03-06T14:16:14.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.321+0000 7f992c942700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992814ff80 con 0x7f99280bdd60 2023-03-06T14:16:14.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.321+0000 7f992659c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f992806ea70 0x7f99280bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:14.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.321+0000 7f992659c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f992806ea70 0x7f99280bd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55920/0 (socket says 172.21.15.3:55920) 2023-03-06T14:16:14.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.322+0000 7f992659c700 1 -- 172.21.15.3:0/1282704989 learned_addr learned my addr 172.21.15.3:0/1282704989 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:14.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.322+0000 7f9926d9d700 1 --2- 172.21.15.3:0/1282704989 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f99280bdd60 0x7f9928149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:14.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.322+0000 7f9925d9b700 1 --2- 172.21.15.3:0/1282704989 >> v2:172.21.15.136:3300/0 conn(0x7f992806ee40 0x7f99281490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:14.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.322+0000 7f992659c700 1 -- 172.21.15.3:0/1282704989 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f99280bdd60 msgr2=0x7f9928149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:14.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.322+0000 7f992659c700 1 --2- 172.21.15.3:0/1282704989 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f99280bdd60 0x7f9928149630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.322+0000 7f992659c700 1 -- 172.21.15.3:0/1282704989 >> v2:172.21.15.136:3300/0 conn(0x7f992806ee40 msgr2=0x7f99281490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:14.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.322+0000 7f992659c700 1 --2- 172.21.15.3:0/1282704989 >> v2:172.21.15.136:3300/0 conn(0x7f992806ee40 0x7f99281490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.322+0000 7f992659c700 1 -- 172.21.15.3:0/1282704989 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99280bcb90 con 0x7f992806ea70 2023-03-06T14:16:14.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.322+0000 7f9925d9b700 1 --2- 172.21.15.3:0/1282704989 >> v2:172.21.15.136:3300/0 conn(0x7f992806ee40 0x7f99281490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:14.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.322+0000 7f992659c700 1 --2- 172.21.15.3:0/1282704989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f992806ea70 0x7f99280bd670 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f99280726c0 tx=0x7f9918009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c9c2f7c918534d server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:14.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.322+0000 7f992559a700 1 -- 172.21.15.3:0/1282704989 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918005e30 con 0x7f992806ea70 2023-03-06T14:16:14.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.322+0000 7f992559a700 1 -- 172.21.15.3:0/1282704989 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9918004030 con 0x7f992806ea70 2023-03-06T14:16:14.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.322+0000 7f992559a700 1 -- 172.21.15.3:0/1282704989 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99180043e0 con 0x7f992806ea70 2023-03-06T14:16:14.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.323+0000 7f992c942700 1 -- 172.21.15.3:0/1282704989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f992806ea70 msgr2=0x7f99280bd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:14.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.323+0000 7f992c942700 1 --2- 172.21.15.3:0/1282704989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f992806ea70 0x7f99280bd670 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f99280726c0 tx=0x7f9918009bd0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.323+0000 7f992c942700 1 -- 172.21.15.3:0/1282704989 shutdown_connections 2023-03-06T14:16:14.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.323+0000 7f992c942700 1 --2- 172.21.15.3:0/1282704989 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f99280bdd60 0x7f9928149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.323+0000 7f992c942700 1 --2- 172.21.15.3:0/1282704989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f992806ea70 0x7f99280bd670 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.323+0000 7f992c942700 1 --2- 172.21.15.3:0/1282704989 >> v2:172.21.15.136:3300/0 conn(0x7f992806ee40 0x7f99281490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.323+0000 7f992c942700 1 -- 172.21.15.3:0/1282704989 >> 172.21.15.3:0/1282704989 conn(0x7f99280c2150 msgr2=0x7f99280c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:14.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.323+0000 7f992c942700 1 -- 172.21.15.3:0/1282704989 shutdown_connections 2023-03-06T14:16:14.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.323+0000 7f992c942700 1 -- 172.21.15.3:0/1282704989 wait complete. 2023-03-06T14:16:14.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.324+0000 7f992c942700 1 Processor -- start 2023-03-06T14:16:14.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.324+0000 7f992c942700 1 -- start start 2023-03-06T14:16:14.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.325+0000 7f992c942700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f992806ea70 0x7f992814c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:14.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.325+0000 7f992c942700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f992806ee40 0x7f992814a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:14.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.325+0000 7f992c942700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f99280bdd60 0x7f99281e6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:14.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.325+0000 7f992c942700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99281e5c40 con 0x7f992806ee40 2023-03-06T14:16:14.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.325+0000 7f992c942700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99280c1c50 con 0x7f992806ea70 2023-03-06T14:16:14.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.325+0000 7f992c942700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992814ef40 con 0x7f99280bdd60 2023-03-06T14:16:14.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.325+0000 7f9925d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f992806ee40 0x7f992814a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:14.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.325+0000 7f9925d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f992806ee40 0x7f992814a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55928/0 (socket says 172.21.15.3:55928) 2023-03-06T14:16:14.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.325+0000 7f9925d9b700 1 -- 172.21.15.3:0/2588328318 learned_addr learned my addr 172.21.15.3:0/2588328318 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:14.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.325+0000 7f9926d9d700 1 --2- 172.21.15.3:0/2588328318 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f99280bdd60 0x7f99281e6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:14.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.325+0000 7f992659c700 1 --2- 172.21.15.3:0/2588328318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f992806ea70 0x7f992814c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:14.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.325+0000 7f9925d9b700 1 -- 172.21.15.3:0/2588328318 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f99280bdd60 msgr2=0x7f99281e6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:14.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.325+0000 7f9925d9b700 1 --2- 172.21.15.3:0/2588328318 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f99280bdd60 0x7f99281e6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.325+0000 7f9925d9b700 1 -- 172.21.15.3:0/2588328318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f992806ea70 msgr2=0x7f992814c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:14.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.325+0000 7f9925d9b700 1 --2- 172.21.15.3:0/2588328318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f992806ea70 0x7f992814c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.325+0000 7f9925d9b700 1 -- 172.21.15.3:0/2588328318 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9918009500 con 0x7f992806ee40 2023-03-06T14:16:14.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.326+0000 7f9925d9b700 1 --2- 172.21.15.3:0/2588328318 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f992806ee40 0x7f992814a570 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f991000d830 tx=0x7f991000db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:14.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.326+0000 7f991effd700 1 -- 172.21.15.3:0/2588328318 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910004030 con 0x7f992806ee40 2023-03-06T14:16:14.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.326+0000 7f991effd700 1 -- 172.21.15.3:0/2588328318 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9910004190 con 0x7f992806ee40 2023-03-06T14:16:14.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.326+0000 7f992c942700 1 -- 172.21.15.3:0/2588328318 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99280bd150 con 0x7f992806ee40 2023-03-06T14:16:14.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.326+0000 7f991effd700 1 -- 172.21.15.3:0/2588328318 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910004520 con 0x7f992806ee40 2023-03-06T14:16:14.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.326+0000 7f992c942700 1 -- 172.21.15.3:0/2588328318 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99280bce70 con 0x7f992806ee40 2023-03-06T14:16:14.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.327+0000 7f992c942700 1 -- 172.21.15.3:0/2588328318 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9928150220 con 0x7f992806ee40 2023-03-06T14:16:14.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.327+0000 7f991effd700 1 -- 172.21.15.3:0/2588328318 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f991001b030 con 0x7f992806ee40 2023-03-06T14:16:14.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.328+0000 7f991effd700 1 --2- 172.21.15.3:0/2588328318 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f99080682f0 0x7f990806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:14.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.328+0000 7f991effd700 1 -- 172.21.15.3:0/2588328318 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9910085640 con 0x7f992806ee40 2023-03-06T14:16:14.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.328+0000 7f992659c700 1 --2- 172.21.15.3:0/2588328318 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f99080682f0 0x7f990806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:14.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.328+0000 7f992659c700 1 --2- 172.21.15.3:0/2588328318 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f99080682f0 0x7f990806a7a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9918009c10 tx=0x7f9918008070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:14.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.332+0000 7f991effd700 1 -- 172.21.15.3:0/2588328318 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f991004d5e0 con 0x7f992806ee40 2023-03-06T14:16:14.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.526+0000 7f992c942700 1 -- 172.21.15.3:0/2588328318 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f992814caf0 con 0x7f992806ee40 2023-03-06T14:16:14.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.527+0000 7f991effd700 1 -- 172.21.15.3:0/2588328318 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19604 (secure 0 0 0) 0x7f9910055690 con 0x7f992806ee40 2023-03-06T14:16:14.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:14.529 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":27,"fsid":"9aae2361-5af0-49eb-8f99-e7f69834fedf","created":"2023-03-06T14:15:33.357348+0000","modified":"2023-03-06T14:16:03.040402+0000","last_up_change":"2023-03-06T14:15:44.374764+0000","last_in_change":"2023-03-06T14:15:35.866803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T14:15:45.023761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T14:15:51.830917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-06T14:15:56.256188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-06T14:15:57.571429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-06T14:16:00.645210+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c92c9e49-8a23-48a5-87e5-51f184f73a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":96679},{"type":"v1","addr":"172.21.15.3:6809","nonce":96679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":96679},{"type":"v1","addr":"172.21.15.3:6811","nonce":96679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":96679},{"type":"v1","addr":"172.21.15.3:6818","nonce":96679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":96679},{"type":"v1","addr":"172.21.15.3:6814","nonce":96679}]},"public_addr":"172.21.15.3:6809/96679","cluster_addr":"172.21.15.3:6811/96679","heartbeat_back_addr":"172.21.15.3:6818/96679","heartbeat_front_addr":"172.21.15.3:6814/96679","state":["exists","up"]},{"osd":1,"uuid":"86ec9127-843f-4246-bfbe-e14ce3af7d17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":96681},{"type":"v1","addr":"172.21.15.3:6825","nonce":96681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":96681},{"type":"v1","addr":"172.21.15.3:6827","nonce":96681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":96681},{"type":"v1","addr":"172.21.15.3:6831","nonce":96681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":96681},{"type":"v1","addr":"172.21.15.3:6829","nonce":96681}]},"public_addr":"172.21.15.3:6825/96681","cluster_addr":"172.21.15.3:6827/96681","heartbeat_back_addr":"172.21.15.3:6831/96681","heartbeat_front_addr":"172.21.15.3:6829/96681","state":["exists","up"]},{"osd":2,"uuid":"67582de3-0f75-4cf0-84ca-e878986f99f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":96682},{"type":"v1","addr":"172.21.15.3:6815","nonce":96682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6817","nonce":96682},{"type":"v1","addr":"172.21.15.3:6819","nonce":96682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":96682},{"type":"v1","addr":"172.21.15.3:6823","nonce":96682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":96682},{"type":"v1","addr":"172.21.15.3:6821","nonce":96682}]},"public_addr":"172.21.15.3:6815/96682","cluster_addr":"172.21.15.3:6819/96682","heartbeat_back_addr":"172.21.15.3:6823/96682","heartbeat_front_addr":"172.21.15.3:6821/96682","state":["exists","up"]},{"osd":3,"uuid":"0fb8d708-4b38-4153-8a60-79741765d439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":96680},{"type":"v1","addr":"172.21.15.3:6801","nonce":96680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":96680},{"type":"v1","addr":"172.21.15.3:6803","nonce":96680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":96680},{"type":"v1","addr":"172.21.15.3:6807","nonce":96680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":96680},{"type":"v1","addr":"172.21.15.3:6805","nonce":96680}]},"public_addr":"172.21.15.3:6801/96680","cluster_addr":"172.21.15.3:6803/96680","heartbeat_back_addr":"172.21.15.3:6807/96680","heartbeat_front_addr":"172.21.15.3:6805/96680","state":["exists","up"]},{"osd":4,"uuid":"44eb9d99-975f-43a3-8bf4-213b2ba6dea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":96798},{"type":"v1","addr":"172.21.15.136:6822","nonce":96798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":96798},{"type":"v1","addr":"172.21.15.136:6826","nonce":96798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":96798},{"type":"v1","addr":"172.21.15.136:6831","nonce":96798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":96798},{"type":"v1","addr":"172.21.15.136:6829","nonce":96798}]},"public_addr":"172.21.15.136:6822/96798","cluster_addr":"172.21.15.136:6826/96798","heartbeat_back_addr":"172.21.15.136:6831/96798","heartbeat_front_addr":"172.21.15.136:6829/96798","state":["exists","up"]},{"osd":5,"uuid":"aff1a438-c444-4ebc-9806-d2d117878a2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":96796},{"type":"v1","addr":"172.21.15.136:6804","nonce":96796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":96796},{"type":"v1","addr":"172.21.15.136:6809","nonce":96796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":96796},{"type":"v1","addr":"172.21.15.136:6815","nonce":96796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":96796},{"type":"v1","addr":"172.21.15.136:6813","nonce":96796}]},"public_addr":"172.21.15.136:6804/96796","cluster_addr":"172.21.15.136:6809/96796","heartbeat_back_addr":"172.21.15.136:6815/96796","heartbeat_front_addr":"172.21.15.136:6813/96796","state":["exists","up"]},{"osd":6,"uuid":"89cc219c-f57b-43f4-8e54-76017dd4930d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":96797},{"type":"v1","addr":"172.21.15.136:6801","nonce":96797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6803","nonce":96797},{"type":"v1","addr":"172.21.15.136:6805","nonce":96797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":96797},{"type":"v1","addr":"172.21.15.136:6811","nonce":96797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":96797},{"type":"v1","addr":"172.21.15.136:6808","nonce":96797}]},"public_addr":"172.21.15.136:6801/96797","cluster_addr":"172.21.15.136:6805/96797","heartbeat_back_addr":"172.21.15.136:6811/96797","heartbeat_front_addr":"172.21.15.136:6808/96797","state":["exists","up"]},{"osd":7,"uuid":"a90e4c14-00de-4d1c-92ce-9f20df714e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":96819},{"type":"v1","addr":"172.21.15.136:6817","nonce":96819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":96819},{"type":"v1","addr":"172.21.15.136:6819","nonce":96819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":96819},{"type":"v1","addr":"172.21.15.136:6827","nonce":96819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":96819},{"type":"v1","addr":"172.21.15.136:6823","nonce":96819}]},"public_addr":"172.21.15.136:6817/96819","cluster_addr":"172.21.15.136:6819/96819","heartbeat_back_addr":"172.21.15.136:6827/96819","heartbeat_front_addr":"172.21.15.136:6823/96819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.093141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.034488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.128137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.097924+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.045441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.005820+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.039918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.082053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T14:16:14.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.529+0000 7f992c942700 1 -- 172.21.15.3:0/2588328318 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f99080682f0 msgr2=0x7f990806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:14.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.529+0000 7f992c942700 1 --2- 172.21.15.3:0/2588328318 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f99080682f0 0x7f990806a7a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9918009c10 tx=0x7f9918008070 comp rx=0 tx=0).stop 2023-03-06T14:16:14.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.529+0000 7f992c942700 1 -- 172.21.15.3:0/2588328318 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f992806ee40 msgr2=0x7f992814a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:14.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.529+0000 7f992c942700 1 --2- 172.21.15.3:0/2588328318 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f992806ee40 0x7f992814a570 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f991000d830 tx=0x7f991000db40 comp rx=0 tx=0).stop 2023-03-06T14:16:14.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.529+0000 7f992c942700 1 -- 172.21.15.3:0/2588328318 shutdown_connections 2023-03-06T14:16:14.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.529+0000 7f992c942700 1 --2- 172.21.15.3:0/2588328318 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f99080682f0 0x7f990806a7a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.529+0000 7f992c942700 1 --2- 172.21.15.3:0/2588328318 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f99280bdd60 0x7f99281e6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.529+0000 7f992c942700 1 --2- 172.21.15.3:0/2588328318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f992806ea70 0x7f992814c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.529+0000 7f992c942700 1 --2- 172.21.15.3:0/2588328318 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f992806ee40 0x7f992814a570 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.529+0000 7f992c942700 1 -- 172.21.15.3:0/2588328318 >> 172.21.15.3:0/2588328318 conn(0x7f99280c2150 msgr2=0x7f99280c0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:14.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.529+0000 7f992c942700 1 -- 172.21.15.3:0/2588328318 shutdown_connections 2023-03-06T14:16:14.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.529+0000 7f992c942700 1 -- 172.21.15.3:0/2588328318 wait complete. 2023-03-06T14:16:14.543 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T14:16:14.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.668+0000 7fc0f2624700 1 Processor -- start 2023-03-06T14:16:14.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.668+0000 7fc0f2624700 1 -- start start 2023-03-06T14:16:14.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.669+0000 7fc0f2624700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc0ec06ea70 0x7fc0ec0bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:14.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.669+0000 7fc0f2624700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc0ec06ee40 0x7fc0ec1490f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:14.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.669+0000 7fc0f2624700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0ec0bdd60 0x7fc0ec149630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:14.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.669+0000 7fc0f2624700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0ec0b9070 con 0x7fc0ec06ea70 2023-03-06T14:16:14.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.669+0000 7fc0f2624700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0ec149b70 con 0x7fc0ec06ee40 2023-03-06T14:16:14.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.669+0000 7fc0f2624700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec14ff80 con 0x7fc0ec0bdd60 2023-03-06T14:16:14.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.669+0000 7fc0ebfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc0ec06ea70 0x7fc0ec0bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:14.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.669+0000 7fc0ebfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc0ec06ea70 0x7fc0ec0bd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55934/0 (socket says 172.21.15.3:55934) 2023-03-06T14:16:14.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.669+0000 7fc0ebfff700 1 -- 172.21.15.3:0/2337796473 learned_addr learned my addr 172.21.15.3:0/2337796473 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:14.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.669+0000 7fc0f0bc1700 1 --2- 172.21.15.3:0/2337796473 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0ec0bdd60 0x7fc0ec149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:14.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.670+0000 7fc0eb7fe700 1 --2- 172.21.15.3:0/2337796473 >> v2:172.21.15.136:3300/0 conn(0x7fc0ec06ee40 0x7fc0ec1490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:14.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.670+0000 7fc0ebfff700 1 -- 172.21.15.3:0/2337796473 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0ec0bdd60 msgr2=0x7fc0ec149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:14.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.670+0000 7fc0ebfff700 1 --2- 172.21.15.3:0/2337796473 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0ec0bdd60 0x7fc0ec149630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.670+0000 7fc0ebfff700 1 -- 172.21.15.3:0/2337796473 >> v2:172.21.15.136:3300/0 conn(0x7fc0ec06ee40 msgr2=0x7fc0ec1490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:14.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.670+0000 7fc0ebfff700 1 --2- 172.21.15.3:0/2337796473 >> v2:172.21.15.136:3300/0 conn(0x7fc0ec06ee40 0x7fc0ec1490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.670+0000 7fc0ebfff700 1 -- 172.21.15.3:0/2337796473 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ec0bcb90 con 0x7fc0ec06ea70 2023-03-06T14:16:14.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.670+0000 7fc0ebfff700 1 --2- 172.21.15.3:0/2337796473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0ec06ea70 0x7fc0ec0bd670 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0726c0 tx=0x7fc0dc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b2f611eda9c50 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:14.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.670+0000 7fc0eaffd700 1 -- 172.21.15.3:0/2337796473 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc005e30 con 0x7fc0ec06ea70 2023-03-06T14:16:14.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.670+0000 7fc0eaffd700 1 -- 172.21.15.3:0/2337796473 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0dc004030 con 0x7fc0ec06ea70 2023-03-06T14:16:14.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.670+0000 7fc0eaffd700 1 -- 172.21.15.3:0/2337796473 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc0043e0 con 0x7fc0ec06ea70 2023-03-06T14:16:14.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.671+0000 7fc0f2624700 1 -- 172.21.15.3:0/2337796473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0ec06ea70 msgr2=0x7fc0ec0bd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:14.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.671+0000 7fc0f2624700 1 --2- 172.21.15.3:0/2337796473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0ec06ea70 0x7fc0ec0bd670 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0726c0 tx=0x7fc0dc009bd0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.671+0000 7fc0f2624700 1 -- 172.21.15.3:0/2337796473 shutdown_connections 2023-03-06T14:16:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.671+0000 7fc0f2624700 1 --2- 172.21.15.3:0/2337796473 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0ec0bdd60 0x7fc0ec149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.671+0000 7fc0f2624700 1 --2- 172.21.15.3:0/2337796473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0ec06ea70 0x7fc0ec0bd670 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.671+0000 7fc0f2624700 1 --2- 172.21.15.3:0/2337796473 >> v2:172.21.15.136:3300/0 conn(0x7fc0ec06ee40 0x7fc0ec1490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.671+0000 7fc0f2624700 1 -- 172.21.15.3:0/2337796473 >> 172.21.15.3:0/2337796473 conn(0x7fc0ec0c2150 msgr2=0x7fc0ec0c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.671+0000 7fc0f2624700 1 -- 172.21.15.3:0/2337796473 shutdown_connections 2023-03-06T14:16:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.671+0000 7fc0f2624700 1 -- 172.21.15.3:0/2337796473 wait complete. 2023-03-06T14:16:14.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.672+0000 7fc0f2624700 1 Processor -- start 2023-03-06T14:16:14.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.672+0000 7fc0f2624700 1 -- start start 2023-03-06T14:16:14.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0f2624700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0ec06ea70 0x7fc0ec14c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:14.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0f2624700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0ec06ee40 0x7fc0ec14a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:14.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0f2624700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0ec0bdd60 0x7fc0ec1e6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:14.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0f2624700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec1e5c40 con 0x7fc0ec06ea70 2023-03-06T14:16:14.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0f2624700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec0c1c50 con 0x7fc0ec06ee40 2023-03-06T14:16:14.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0f2624700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec14ef40 con 0x7fc0ec0bdd60 2023-03-06T14:16:14.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0ebfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0ec06ea70 0x7fc0ec14c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:14.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0ebfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0ec06ea70 0x7fc0ec14c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55938/0 (socket says 172.21.15.3:55938) 2023-03-06T14:16:14.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0ebfff700 1 -- 172.21.15.3:0/1399137310 learned_addr learned my addr 172.21.15.3:0/1399137310 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:14.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0eb7fe700 1 --2- 172.21.15.3:0/1399137310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0ec06ee40 0x7fc0ec14a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:14.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0f0bc1700 1 --2- 172.21.15.3:0/1399137310 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0ec0bdd60 0x7fc0ec1e6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:14.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0ebfff700 1 -- 172.21.15.3:0/1399137310 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0ec0bdd60 msgr2=0x7fc0ec1e6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:14.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0ebfff700 1 --2- 172.21.15.3:0/1399137310 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0ec0bdd60 0x7fc0ec1e6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0ebfff700 1 -- 172.21.15.3:0/1399137310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0ec06ee40 msgr2=0x7fc0ec14a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:14.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0ebfff700 1 --2- 172.21.15.3:0/1399137310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0ec06ee40 0x7fc0ec14a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0ebfff700 1 -- 172.21.15.3:0/1399137310 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc009500 con 0x7fc0ec06ea70 2023-03-06T14:16:14.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0f0bc1700 1 --2- 172.21.15.3:0/1399137310 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0ec0bdd60 0x7fc0ec1e6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:14.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0ebfff700 1 --2- 172.21.15.3:0/1399137310 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0ec06ea70 0x7fc0ec14c5b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0c2eb0 tx=0x7fc0dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:14.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0e8ff9700 1 -- 172.21.15.3:0/1399137310 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc003c30 con 0x7fc0ec06ea70 2023-03-06T14:16:14.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0e8ff9700 1 -- 172.21.15.3:0/1399137310 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0dc003d90 con 0x7fc0ec06ea70 2023-03-06T14:16:14.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0f2624700 1 -- 172.21.15.3:0/1399137310 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0ec0bd150 con 0x7fc0ec06ea70 2023-03-06T14:16:14.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.673+0000 7fc0e8ff9700 1 -- 172.21.15.3:0/1399137310 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc01c640 con 0x7fc0ec06ea70 2023-03-06T14:16:14.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.674+0000 7fc0f2624700 1 -- 172.21.15.3:0/1399137310 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0ec0bce70 con 0x7fc0ec06ea70 2023-03-06T14:16:14.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.674+0000 7fc0f2624700 1 -- 172.21.15.3:0/1399137310 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0ec150220 con 0x7fc0ec06ea70 2023-03-06T14:16:14.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.675+0000 7fc0e8ff9700 1 -- 172.21.15.3:0/1399137310 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc0dc02c070 con 0x7fc0ec06ea70 2023-03-06T14:16:14.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.676+0000 7fc0e8ff9700 1 --2- 172.21.15.3:0/1399137310 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0d80682f0 0x7fc0d806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:14.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.676+0000 7fc0e8ff9700 1 -- 172.21.15.3:0/1399137310 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc0dc087310 con 0x7fc0ec06ea70 2023-03-06T14:16:14.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.676+0000 7fc0eb7fe700 1 --2- 172.21.15.3:0/1399137310 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0d80682f0 0x7fc0d806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:14.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.677+0000 7fc0eb7fe700 1 --2- 172.21.15.3:0/1399137310 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0d80682f0 0x7fc0d806a7a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0b74d0 tx=0x7fc0e0009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:14.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.679+0000 7fc0e8ff9700 1 -- 172.21.15.3:0/1399137310 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc0dc053810 con 0x7fc0ec06ea70 2023-03-06T14:16:14.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.876+0000 7fc0f2624700 1 -- 172.21.15.3:0/1399137310 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0ec14cb20 con 0x7fc0ec06ea70 2023-03-06T14:16:14.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.877+0000 7fc0e8ff9700 1 -- 172.21.15.3:0/1399137310 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19604 (secure 0 0 0) 0x7fc0ec14cb20 con 0x7fc0ec06ea70 2023-03-06T14:16:14.879 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:14.879 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":27,"fsid":"9aae2361-5af0-49eb-8f99-e7f69834fedf","created":"2023-03-06T14:15:33.357348+0000","modified":"2023-03-06T14:16:03.040402+0000","last_up_change":"2023-03-06T14:15:44.374764+0000","last_in_change":"2023-03-06T14:15:35.866803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T14:15:45.023761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T14:15:51.830917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-06T14:15:56.256188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-06T14:15:57.571429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-06T14:16:00.645210+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c92c9e49-8a23-48a5-87e5-51f184f73a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":96679},{"type":"v1","addr":"172.21.15.3:6809","nonce":96679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":96679},{"type":"v1","addr":"172.21.15.3:6811","nonce":96679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":96679},{"type":"v1","addr":"172.21.15.3:6818","nonce":96679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":96679},{"type":"v1","addr":"172.21.15.3:6814","nonce":96679}]},"public_addr":"172.21.15.3:6809/96679","cluster_addr":"172.21.15.3:6811/96679","heartbeat_back_addr":"172.21.15.3:6818/96679","heartbeat_front_addr":"172.21.15.3:6814/96679","state":["exists","up"]},{"osd":1,"uuid":"86ec9127-843f-4246-bfbe-e14ce3af7d17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":96681},{"type":"v1","addr":"172.21.15.3:6825","nonce":96681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":96681},{"type":"v1","addr":"172.21.15.3:6827","nonce":96681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":96681},{"type":"v1","addr":"172.21.15.3:6831","nonce":96681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":96681},{"type":"v1","addr":"172.21.15.3:6829","nonce":96681}]},"public_addr":"172.21.15.3:6825/96681","cluster_addr":"172.21.15.3:6827/96681","heartbeat_back_addr":"172.21.15.3:6831/96681","heartbeat_front_addr":"172.21.15.3:6829/96681","state":["exists","up"]},{"osd":2,"uuid":"67582de3-0f75-4cf0-84ca-e878986f99f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":96682},{"type":"v1","addr":"172.21.15.3:6815","nonce":96682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6817","nonce":96682},{"type":"v1","addr":"172.21.15.3:6819","nonce":96682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":96682},{"type":"v1","addr":"172.21.15.3:6823","nonce":96682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":96682},{"type":"v1","addr":"172.21.15.3:6821","nonce":96682}]},"public_addr":"172.21.15.3:6815/96682","cluster_addr":"172.21.15.3:6819/96682","heartbeat_back_addr":"172.21.15.3:6823/96682","heartbeat_front_addr":"172.21.15.3:6821/96682","state":["exists","up"]},{"osd":3,"uuid":"0fb8d708-4b38-4153-8a60-79741765d439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":96680},{"type":"v1","addr":"172.21.15.3:6801","nonce":96680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":96680},{"type":"v1","addr":"172.21.15.3:6803","nonce":96680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":96680},{"type":"v1","addr":"172.21.15.3:6807","nonce":96680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":96680},{"type":"v1","addr":"172.21.15.3:6805","nonce":96680}]},"public_addr":"172.21.15.3:6801/96680","cluster_addr":"172.21.15.3:6803/96680","heartbeat_back_addr":"172.21.15.3:6807/96680","heartbeat_front_addr":"172.21.15.3:6805/96680","state":["exists","up"]},{"osd":4,"uuid":"44eb9d99-975f-43a3-8bf4-213b2ba6dea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":96798},{"type":"v1","addr":"172.21.15.136:6822","nonce":96798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":96798},{"type":"v1","addr":"172.21.15.136:6826","nonce":96798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":96798},{"type":"v1","addr":"172.21.15.136:6831","nonce":96798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":96798},{"type":"v1","addr":"172.21.15.136:6829","nonce":96798}]},"public_addr":"172.21.15.136:6822/96798","cluster_addr":"172.21.15.136:6826/96798","heartbeat_back_addr":"172.21.15.136:6831/96798","heartbeat_front_addr":"172.21.15.136:6829/96798","state":["exists","up"]},{"osd":5,"uuid":"aff1a438-c444-4ebc-9806-d2d117878a2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":96796},{"type":"v1","addr":"172.21.15.136:6804","nonce":96796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":96796},{"type":"v1","addr":"172.21.15.136:6809","nonce":96796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":96796},{"type":"v1","addr":"172.21.15.136:6815","nonce":96796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":96796},{"type":"v1","addr":"172.21.15.136:6813","nonce":96796}]},"public_addr":"172.21.15.136:6804/96796","cluster_addr":"172.21.15.136:6809/96796","heartbeat_back_addr":"172.21.15.136:6815/96796","heartbeat_front_addr":"172.21.15.136:6813/96796","state":["exists","up"]},{"osd":6,"uuid":"89cc219c-f57b-43f4-8e54-76017dd4930d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":96797},{"type":"v1","addr":"172.21.15.136:6801","nonce":96797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6803","nonce":96797},{"type":"v1","addr":"172.21.15.136:6805","nonce":96797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":96797},{"type":"v1","addr":"172.21.15.136:6811","nonce":96797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":96797},{"type":"v1","addr":"172.21.15.136:6808","nonce":96797}]},"public_addr":"172.21.15.136:6801/96797","cluster_addr":"172.21.15.136:6805/96797","heartbeat_back_addr":"172.21.15.136:6811/96797","heartbeat_front_addr":"172.21.15.136:6808/96797","state":["exists","up"]},{"osd":7,"uuid":"a90e4c14-00de-4d1c-92ce-9f20df714e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":96819},{"type":"v1","addr":"172.21.15.136:6817","nonce":96819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":96819},{"type":"v1","addr":"172.21.15.136:6819","nonce":96819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":96819},{"type":"v1","addr":"172.21.15.136:6827","nonce":96819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":96819},{"type":"v1","addr":"172.21.15.136:6823","nonce":96819}]},"public_addr":"172.21.15.136:6817/96819","cluster_addr":"172.21.15.136:6819/96819","heartbeat_back_addr":"172.21.15.136:6827/96819","heartbeat_front_addr":"172.21.15.136:6823/96819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.093141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.034488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.128137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.097924+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.045441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.005820+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.039918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.082053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T14:16:14.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.879+0000 7fc0f2624700 1 -- 172.21.15.3:0/1399137310 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0d80682f0 msgr2=0x7fc0d806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:14.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.879+0000 7fc0f2624700 1 --2- 172.21.15.3:0/1399137310 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0d80682f0 0x7fc0d806a7a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0b74d0 tx=0x7fc0e0009210 comp rx=0 tx=0).stop 2023-03-06T14:16:14.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.879+0000 7fc0f2624700 1 -- 172.21.15.3:0/1399137310 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0ec06ea70 msgr2=0x7fc0ec14c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:14.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.879+0000 7fc0f2624700 1 --2- 172.21.15.3:0/1399137310 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0ec06ea70 0x7fc0ec14c5b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0c2eb0 tx=0x7fc0dc004750 comp rx=0 tx=0).stop 2023-03-06T14:16:14.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.880+0000 7fc0f2624700 1 -- 172.21.15.3:0/1399137310 shutdown_connections 2023-03-06T14:16:14.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.880+0000 7fc0f2624700 1 --2- 172.21.15.3:0/1399137310 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc0d80682f0 0x7fc0d806a7a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.880+0000 7fc0f2624700 1 --2- 172.21.15.3:0/1399137310 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0ec06ea70 0x7fc0ec14c5b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.880+0000 7fc0f2624700 1 --2- 172.21.15.3:0/1399137310 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0ec0bdd60 0x7fc0ec1e6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.880+0000 7fc0f2624700 1 --2- 172.21.15.3:0/1399137310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0ec06ee40 0x7fc0ec14a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:14.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.880+0000 7fc0f2624700 1 -- 172.21.15.3:0/1399137310 >> 172.21.15.3:0/1399137310 conn(0x7fc0ec0c2150 msgr2=0x7fc0ec0c0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:14.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.880+0000 7fc0f2624700 1 -- 172.21.15.3:0/1399137310 shutdown_connections 2023-03-06T14:16:14.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:14.880+0000 7fc0f2624700 1 -- 172.21.15.3:0/1399137310 wait complete. 2023-03-06T14:16:14.894 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-03-06T14:16:15.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.022+0000 7f83bf2b2700 1 Processor -- start 2023-03-06T14:16:15.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.022+0000 7f83bf2b2700 1 -- start start 2023-03-06T14:16:15.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.023+0000 7f83bf2b2700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f83b8148a00 0x7f83b80b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:15.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.023+0000 7f83bf2b2700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f83b80704b0 0x7f83b814be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:15.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.023+0000 7f83bf2b2700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83b80bc3c0 0x7f83b80bcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:15.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.023+0000 7f83bf2b2700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b814b4a0 con 0x7f83b80704b0 2023-03-06T14:16:15.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.023+0000 7f83bf2b2700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b80b6890 con 0x7f83b8148a00 2023-03-06T14:16:15.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.023+0000 7f83bf2b2700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b80b6d30 con 0x7f83b80bc3c0 2023-03-06T14:16:15.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.023+0000 7f83bc84d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f83b80704b0 0x7f83b814be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:15.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.023+0000 7f83bc84d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f83b80704b0 0x7f83b814be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55948/0 (socket says 172.21.15.3:55948) 2023-03-06T14:16:15.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.023+0000 7f83bc84d700 1 -- 172.21.15.3:0/847447627 learned_addr learned my addr 172.21.15.3:0/847447627 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:15.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.023+0000 7f83bd04e700 1 --2- 172.21.15.3:0/847447627 >> v2:172.21.15.136:3300/0 conn(0x7f83b8148a00 0x7f83b80b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:15.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.023+0000 7f83bd84f700 1 --2- 172.21.15.3:0/847447627 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83b80bc3c0 0x7f83b80bcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:15.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.023+0000 7f83bc84d700 1 -- 172.21.15.3:0/847447627 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83b80bc3c0 msgr2=0x7f83b80bcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:15.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.023+0000 7f83bc84d700 1 --2- 172.21.15.3:0/847447627 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83b80bc3c0 0x7f83b80bcf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:15.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.023+0000 7f83bc84d700 1 -- 172.21.15.3:0/847447627 >> v2:172.21.15.136:3300/0 conn(0x7f83b8148a00 msgr2=0x7f83b80b7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:15.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.023+0000 7f83bc84d700 1 --2- 172.21.15.3:0/847447627 >> v2:172.21.15.136:3300/0 conn(0x7f83b8148a00 0x7f83b80b7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:15.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.023+0000 7f83bc84d700 1 -- 172.21.15.3:0/847447627 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b814b6b0 con 0x7f83b80704b0 2023-03-06T14:16:15.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.024+0000 7f83bc84d700 1 --2- 172.21.15.3:0/847447627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83b80704b0 0x7f83b814be70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f83b80bb550 tx=0x7f83b400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1629bb0bc621dc server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:15.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.024+0000 7f83affff700 1 -- 172.21.15.3:0/847447627 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b400dc20 con 0x7f83b80704b0 2023-03-06T14:16:15.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.024+0000 7f83affff700 1 -- 172.21.15.3:0/847447627 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b400dd80 con 0x7f83b80704b0 2023-03-06T14:16:15.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.024+0000 7f83affff700 1 -- 172.21.15.3:0/847447627 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b4017630 con 0x7f83b80704b0 2023-03-06T14:16:15.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.024+0000 7f83bf2b2700 1 -- 172.21.15.3:0/847447627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83b80704b0 msgr2=0x7f83b814be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:15.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.024+0000 7f83bf2b2700 1 --2- 172.21.15.3:0/847447627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83b80704b0 0x7f83b814be70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f83b80bb550 tx=0x7f83b400be70 comp rx=0 tx=0).stop 2023-03-06T14:16:15.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.024+0000 7f83bf2b2700 1 -- 172.21.15.3:0/847447627 shutdown_connections 2023-03-06T14:16:15.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.024+0000 7f83bf2b2700 1 --2- 172.21.15.3:0/847447627 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83b80bc3c0 0x7f83b80bcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:15.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.024+0000 7f83bf2b2700 1 --2- 172.21.15.3:0/847447627 >> v2:172.21.15.136:3300/0 conn(0x7f83b8148a00 0x7f83b80b7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:15.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.024+0000 7f83bf2b2700 1 --2- 172.21.15.3:0/847447627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83b80704b0 0x7f83b814be70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:15.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.024+0000 7f83bf2b2700 1 -- 172.21.15.3:0/847447627 >> 172.21.15.3:0/847447627 conn(0x7f83b80c0eb0 msgr2=0x7f83b80c12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:15.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.024+0000 7f83bf2b2700 1 -- 172.21.15.3:0/847447627 shutdown_connections 2023-03-06T14:16:15.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.024+0000 7f83bf2b2700 1 -- 172.21.15.3:0/847447627 wait complete. 2023-03-06T14:16:15.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.025+0000 7f83bf2b2700 1 Processor -- start 2023-03-06T14:16:15.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.026+0000 7f83bf2b2700 1 -- start start 2023-03-06T14:16:15.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.026+0000 7f83bf2b2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83b80bc3c0 0x7f83b80bcf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:15.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.026+0000 7f83bf2b2700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83b8148a00 0x7f83b813f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:15.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.026+0000 7f83bf2b2700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83b80bec90 0x7f83b813abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:15.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.026+0000 7f83bf2b2700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b8141890 con 0x7f83b80bec90 2023-03-06T14:16:15.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.026+0000 7f83bf2b2700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b81410b0 con 0x7f83b80bc3c0 2023-03-06T14:16:15.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.026+0000 7f83bf2b2700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b806e600 con 0x7f83b8148a00 2023-03-06T14:16:15.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.026+0000 7f83bd84f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83b80bec90 0x7f83b813abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:15.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.026+0000 7f83bd84f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83b80bec90 0x7f83b813abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55956/0 (socket says 172.21.15.3:55956) 2023-03-06T14:16:15.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.026+0000 7f83bd84f700 1 -- 172.21.15.3:0/1046138115 learned_addr learned my addr 172.21.15.3:0/1046138115 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:15.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.026+0000 7f83bc84d700 1 --2- 172.21.15.3:0/1046138115 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83b8148a00 0x7f83b813f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:15.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.026+0000 7f83bd04e700 1 --2- 172.21.15.3:0/1046138115 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83b80bc3c0 0x7f83b80bcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:15.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.027+0000 7f83bd84f700 1 -- 172.21.15.3:0/1046138115 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83b8148a00 msgr2=0x7f83b813f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:15.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.027+0000 7f83bd84f700 1 --2- 172.21.15.3:0/1046138115 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83b8148a00 0x7f83b813f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:15.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.027+0000 7f83bd84f700 1 -- 172.21.15.3:0/1046138115 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83b80bc3c0 msgr2=0x7f83b80bcf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:15.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.027+0000 7f83bd84f700 1 --2- 172.21.15.3:0/1046138115 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83b80bc3c0 0x7f83b80bcf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:15.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.027+0000 7f83bd84f700 1 -- 172.21.15.3:0/1046138115 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b400b7f0 con 0x7f83b80bec90 2023-03-06T14:16:15.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.027+0000 7f83bd04e700 1 --2- 172.21.15.3:0/1046138115 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83b80bc3c0 0x7f83b80bcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:15.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.027+0000 7f83bd84f700 1 --2- 172.21.15.3:0/1046138115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83b80bec90 0x7f83b813abf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f83b0007e60 tx=0x7f83b000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:15.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.027+0000 7f83adffb700 1 -- 172.21.15.3:0/1046138115 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b000ede0 con 0x7f83b80bec90 2023-03-06T14:16:15.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.027+0000 7f83adffb700 1 -- 172.21.15.3:0/1046138115 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b0014420 con 0x7f83b80bec90 2023-03-06T14:16:15.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.027+0000 7f83bf2b2700 1 -- 172.21.15.3:0/1046138115 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b80b6fd0 con 0x7f83b80bec90 2023-03-06T14:16:15.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.027+0000 7f83adffb700 1 -- 172.21.15.3:0/1046138115 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b00147d0 con 0x7f83b80bec90 2023-03-06T14:16:15.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.027+0000 7f83bf2b2700 1 -- 172.21.15.3:0/1046138115 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b80b72b0 con 0x7f83b80bec90 2023-03-06T14:16:15.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.028+0000 7f83bf2b2700 1 -- 172.21.15.3:0/1046138115 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b814b950 con 0x7f83b80bec90 2023-03-06T14:16:15.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.028+0000 7f83adffb700 1 -- 172.21.15.3:0/1046138115 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f83b0012050 con 0x7f83b80bec90 2023-03-06T14:16:15.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.029+0000 7f83adffb700 1 --2- 172.21.15.3:0/1046138115 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f839c0682f0 0x7f839c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:15.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.029+0000 7f83adffb700 1 -- 172.21.15.3:0/1046138115 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f83b0086530 con 0x7f83b80bec90 2023-03-06T14:16:15.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.029+0000 7f83bd04e700 1 --2- 172.21.15.3:0/1046138115 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f839c0682f0 0x7f839c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:15.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.029+0000 7f83bd04e700 1 --2- 172.21.15.3:0/1046138115 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f839c0682f0 0x7f839c06a7a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f83a8007a50 tx=0x7f83a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:15.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.033+0000 7f83adffb700 1 -- 172.21.15.3:0/1046138115 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f83b0052aa0 con 0x7f83b80bec90 2023-03-06T14:16:15.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:15.271+0000 7f83bf2b2700 1 -- 172.21.15.3:0/1046138115 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f83b8066ca0 con 0x7f83b80bec90 2023-03-06T14:16:16.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.169+0000 7f83adffb700 1 -- 172.21.15.3:0/1046138115 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f83b00560c0 con 0x7f83b80bec90 2023-03-06T14:16:16.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.172+0000 7f83bf2b2700 1 -- 172.21.15.3:0/1046138115 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f839c0682f0 msgr2=0x7f839c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:16.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.172+0000 7f83bf2b2700 1 --2- 172.21.15.3:0/1046138115 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f839c0682f0 0x7f839c06a7a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f83a8007a50 tx=0x7f83a8008040 comp rx=0 tx=0).stop 2023-03-06T14:16:16.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.172+0000 7f83bf2b2700 1 -- 172.21.15.3:0/1046138115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83b80bec90 msgr2=0x7f83b813abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:16.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.172+0000 7f83bf2b2700 1 --2- 172.21.15.3:0/1046138115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83b80bec90 0x7f83b813abf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f83b0007e60 tx=0x7f83b000e3c0 comp rx=0 tx=0).stop 2023-03-06T14:16:16.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.172+0000 7f83bf2b2700 1 -- 172.21.15.3:0/1046138115 shutdown_connections 2023-03-06T14:16:16.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.172+0000 7f83bf2b2700 1 --2- 172.21.15.3:0/1046138115 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f839c0682f0 0x7f839c06a7a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:16.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.172+0000 7f83bf2b2700 1 --2- 172.21.15.3:0/1046138115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83b80bec90 0x7f83b813abf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:16.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.172+0000 7f83bf2b2700 1 --2- 172.21.15.3:0/1046138115 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83b80bc3c0 0x7f83b80bcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:16.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.172+0000 7f83bf2b2700 1 --2- 172.21.15.3:0/1046138115 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83b8148a00 0x7f83b813f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:16.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.172+0000 7f83bf2b2700 1 -- 172.21.15.3:0/1046138115 >> 172.21.15.3:0/1046138115 conn(0x7f83b80c0eb0 msgr2=0x7f83b8149210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:16.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.172+0000 7f83bf2b2700 1 -- 172.21.15.3:0/1046138115 shutdown_connections 2023-03-06T14:16:16.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.172+0000 7f83bf2b2700 1 -- 172.21.15.3:0/1046138115 wait complete. 2023-03-06T14:16:16.189 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-03-06T14:16:16.189 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-03-06T14:16:16.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.323+0000 7fcc04c44700 1 Processor -- start 2023-03-06T14:16:16.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.323+0000 7fcc04c44700 1 -- start start 2023-03-06T14:16:16.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.324+0000 7fcc04c44700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcc000b6670 0x7fcc000bc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:16.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.324+0000 7fcc04c44700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc00145e70 0x7fcc001567a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:16.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.324+0000 7fcc04c44700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc000b6b50 con 0x7fcc000bc5b0 2023-03-06T14:16:16.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.324+0000 7fcc04c44700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc000be090 con 0x7fcc000b6670 2023-03-06T14:16:16.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.324+0000 7fcc04c44700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000bd490 con 0x7fcc00145e70 2023-03-06T14:16:16.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.324+0000 7fcbfdd9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcc000b6670 0x7fcc000bc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:16.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.324+0000 7fcbfe59c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fcc000bc5b0 0x7fcc000bd980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58232/0 (socket says 172.21.15.3:58232) 2023-03-06T14:16:16.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.325+0000 7fcbfe59c700 1 -- 172.21.15.3:0/1650775475 learned_addr learned my addr 172.21.15.3:0/1650775475 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:16.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.325+0000 7fcbfdd9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcc000b6670 0x7fcc000bc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55962/0 (socket says 172.21.15.3:55962) 2023-03-06T14:16:16.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.325+0000 7fcbfed9d700 1 --2- 172.21.15.3:0/1650775475 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc00145e70 0x7fcc001567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:16.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.325+0000 7fcbfdd9b700 1 -- 172.21.15.3:0/1650775475 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc00145e70 msgr2=0x7fcc001567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:16.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.325+0000 7fcbfdd9b700 1 --2- 172.21.15.3:0/1650775475 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc00145e70 0x7fcc001567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:16.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.325+0000 7fcbfdd9b700 1 -- 172.21.15.3:0/1650775475 >> v1:172.21.15.3:6789/0 conn(0x7fcc000bc5b0 legacy=0x7fcc000bd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:16.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.325+0000 7fcbfdd9b700 1 -- 172.21.15.3:0/1650775475 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc000a3190 con 0x7fcc000b6670 2023-03-06T14:16:16.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.325+0000 7fcbfd59a700 1 -- 172.21.15.3:0/1650775475 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794708674 0 0) 0x7fcc000b6b50 con 0x7fcc000bc5b0 2023-03-06T14:16:16.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.325+0000 7fcbfed9d700 1 --2- 172.21.15.3:0/1650775475 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc00145e70 0x7fcc001567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:16.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.325+0000 7fcbfdd9b700 1 --2- 172.21.15.3:0/1650775475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc000b6670 0x7fcc000bc980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000bae0 tx=0x7fcbf000bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7c915ce6680c7c server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:16.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.325+0000 7fcbfd59a700 1 -- 172.21.15.3:0/1650775475 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf000dd30 con 0x7fcc000b6670 2023-03-06T14:16:16.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.325+0000 7fcbfd59a700 1 -- 172.21.15.3:0/1650775475 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf000de90 con 0x7fcc000b6670 2023-03-06T14:16:16.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.325+0000 7fcbfd59a700 1 -- 172.21.15.3:0/1650775475 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0010690 con 0x7fcc000b6670 2023-03-06T14:16:16.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.326+0000 7fcc04c44700 1 -- 172.21.15.3:0/1650775475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc000b6670 msgr2=0x7fcc000bc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:16.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.326+0000 7fcc04c44700 1 --2- 172.21.15.3:0/1650775475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc000b6670 0x7fcc000bc980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000bae0 tx=0x7fcbf000bdf0 comp rx=0 tx=0).stop 2023-03-06T14:16:16.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.326+0000 7fcc04c44700 1 -- 172.21.15.3:0/1650775475 shutdown_connections 2023-03-06T14:16:16.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.326+0000 7fcc04c44700 1 --2- 172.21.15.3:0/1650775475 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc00145e70 0x7fcc001567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:16.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.326+0000 7fcc04c44700 1 --2- 172.21.15.3:0/1650775475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc000b6670 0x7fcc000bc980 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:16.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.326+0000 7fcc04c44700 1 -- 172.21.15.3:0/1650775475 >> 172.21.15.3:0/1650775475 conn(0x7fcc000c17d0 msgr2=0x7fcc000c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:16.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.326+0000 7fcc04c44700 1 -- 172.21.15.3:0/1650775475 shutdown_connections 2023-03-06T14:16:16.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.326+0000 7fcc04c44700 1 -- 172.21.15.3:0/1650775475 wait complete. 2023-03-06T14:16:16.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.327+0000 7fcc04c44700 1 Processor -- start 2023-03-06T14:16:16.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.327+0000 7fcc04c44700 1 -- start start 2023-03-06T14:16:16.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.328+0000 7fcc04c44700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc000b6670 0x7fcc0013fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:16.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.328+0000 7fcc04c44700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc000bc5b0 0x7fcc001d6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:16.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.328+0000 7fcc04c44700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc00145e70 0x7fcc000bffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:16.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.328+0000 7fcc04c44700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000c15d0 con 0x7fcc000b6670 2023-03-06T14:16:16.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.328+0000 7fcc04c44700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0013ff90 con 0x7fcc000bc5b0 2023-03-06T14:16:16.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.328+0000 7fcc04c44700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc001e7b70 con 0x7fcc00145e70 2023-03-06T14:16:16.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.328+0000 7fcbfe59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc000b6670 0x7fcc0013fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:16.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.328+0000 7fcbfe59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc000b6670 0x7fcc0013fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55966/0 (socket says 172.21.15.3:55966) 2023-03-06T14:16:16.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.328+0000 7fcbfe59c700 1 -- 172.21.15.3:0/4087582005 learned_addr learned my addr 172.21.15.3:0/4087582005 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:16.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.328+0000 7fcbfed9d700 1 --2- 172.21.15.3:0/4087582005 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc00145e70 0x7fcc000bffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:16.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.328+0000 7fcbfdd9b700 1 --2- 172.21.15.3:0/4087582005 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc000bc5b0 0x7fcc001d6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:16.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.328+0000 7fcbfe59c700 1 -- 172.21.15.3:0/4087582005 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc00145e70 msgr2=0x7fcc000bffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:16.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.328+0000 7fcbfe59c700 1 --2- 172.21.15.3:0/4087582005 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc00145e70 0x7fcc000bffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:16.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.328+0000 7fcbfe59c700 1 -- 172.21.15.3:0/4087582005 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc000bc5b0 msgr2=0x7fcc001d6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:16.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.328+0000 7fcbfe59c700 1 --2- 172.21.15.3:0/4087582005 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc000bc5b0 0x7fcc001d6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:16.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.328+0000 7fcbfe59c700 1 -- 172.21.15.3:0/4087582005 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf000b740 con 0x7fcc000b6670 2023-03-06T14:16:16.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.328+0000 7fcbfdd9b700 1 --2- 172.21.15.3:0/4087582005 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc000bc5b0 0x7fcc001d6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:16.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.328+0000 7fcbfe59c700 1 --2- 172.21.15.3:0/4087582005 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc000b6670 0x7fcc0013fa50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40011e0 tx=0x7fcbf400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:16.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.329+0000 7fcbeeffd700 1 -- 172.21.15.3:0/4087582005 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4004c80 con 0x7fcc000b6670 2023-03-06T14:16:16.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.329+0000 7fcbeeffd700 1 -- 172.21.15.3:0/4087582005 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf4004de0 con 0x7fcc000b6670 2023-03-06T14:16:16.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.329+0000 7fcbeeffd700 1 -- 172.21.15.3:0/4087582005 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4007310 con 0x7fcc000b6670 2023-03-06T14:16:16.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.329+0000 7fcc04c44700 1 -- 172.21.15.3:0/4087582005 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0014ff30 con 0x7fcc000b6670 2023-03-06T14:16:16.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.329+0000 7fcc04c44700 1 -- 172.21.15.3:0/4087582005 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc000a2eb0 con 0x7fcc000b6670 2023-03-06T14:16:16.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.330+0000 7fcc04c44700 1 -- 172.21.15.3:0/4087582005 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc00150210 con 0x7fcc000b6670 2023-03-06T14:16:16.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.330+0000 7fcbeeffd700 1 -- 172.21.15.3:0/4087582005 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fcbf401a020 con 0x7fcc000b6670 2023-03-06T14:16:16.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.331+0000 7fcbeeffd700 1 --2- 172.21.15.3:0/4087582005 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fcbe00682f0 0x7fcbe006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:16.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.331+0000 7fcbeeffd700 1 -- 172.21.15.3:0/4087582005 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcbf4085bc0 con 0x7fcc000b6670 2023-03-06T14:16:16.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.331+0000 7fcbfdd9b700 1 --2- 172.21.15.3:0/4087582005 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fcbe00682f0 0x7fcbe006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:16.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.331+0000 7fcbfdd9b700 1 --2- 172.21.15.3:0/4087582005 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fcbe00682f0 0x7fcbe006a7a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000b2c0 tx=0x7fcbf0013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:16.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.335+0000 7fcbeeffd700 1 -- 172.21.15.3:0/4087582005 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fcbf40520b0 con 0x7fcc000b6670 2023-03-06T14:16:16.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:16.574+0000 7fcc04c44700 1 -- 172.21.15.3:0/4087582005 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcc001d6870 con 0x7fcc000b6670 2023-03-06T14:16:17.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.179+0000 7fcbeeffd700 1 -- 172.21.15.3:0/4087582005 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcbf40556d0 con 0x7fcc000b6670 2023-03-06T14:16:17.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.181+0000 7fcc04c44700 1 -- 172.21.15.3:0/4087582005 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fcbe00682f0 msgr2=0x7fcbe006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:17.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.181+0000 7fcc04c44700 1 --2- 172.21.15.3:0/4087582005 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fcbe00682f0 0x7fcbe006a7a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000b2c0 tx=0x7fcbf0013000 comp rx=0 tx=0).stop 2023-03-06T14:16:17.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.181+0000 7fcc04c44700 1 -- 172.21.15.3:0/4087582005 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc000b6670 msgr2=0x7fcc0013fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:17.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.181+0000 7fcc04c44700 1 --2- 172.21.15.3:0/4087582005 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc000b6670 0x7fcc0013fa50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40011e0 tx=0x7fcbf400ca30 comp rx=0 tx=0).stop 2023-03-06T14:16:17.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.181+0000 7fcc04c44700 1 -- 172.21.15.3:0/4087582005 shutdown_connections 2023-03-06T14:16:17.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.181+0000 7fcc04c44700 1 --2- 172.21.15.3:0/4087582005 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fcbe00682f0 0x7fcbe006a7a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.181+0000 7fcc04c44700 1 --2- 172.21.15.3:0/4087582005 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc000b6670 0x7fcc0013fa50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.181+0000 7fcc04c44700 1 --2- 172.21.15.3:0/4087582005 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc00145e70 0x7fcc000bffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.182+0000 7fcc04c44700 1 --2- 172.21.15.3:0/4087582005 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc000bc5b0 0x7fcc001d6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.182+0000 7fcc04c44700 1 -- 172.21.15.3:0/4087582005 >> 172.21.15.3:0/4087582005 conn(0x7fcc000c17d0 msgr2=0x7fcc00141ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:17.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.182+0000 7fcc04c44700 1 -- 172.21.15.3:0/4087582005 shutdown_connections 2023-03-06T14:16:17.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.182+0000 7fcc04c44700 1 -- 172.21.15.3:0/4087582005 wait complete. 2023-03-06T14:16:17.197 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-03-06T14:16:17.198 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-06T14:16:17.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.325+0000 7fa1bc2e7700 1 Processor -- start 2023-03-06T14:16:17.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.325+0000 7fa1bc2e7700 1 -- start start 2023-03-06T14:16:17.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.326+0000 7fa1bc2e7700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1b406ea70 0x7fa1b40bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:17.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.326+0000 7fa1bc2e7700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa1b406ee40 0x7fa1b41490f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:17.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.326+0000 7fa1bc2e7700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b414ff80 con 0x7fa1b40bdd60 2023-03-06T14:16:17.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.326+0000 7fa1bc2e7700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b40b9070 con 0x7fa1b406ee40 2023-03-06T14:16:17.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.326+0000 7fa1bc2e7700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b40bcb90 con 0x7fa1b406ea70 2023-03-06T14:16:17.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.326+0000 7fa1ba884700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fa1b40bdd60 0x7fa1b406c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58250/0 (socket says 172.21.15.3:58250) 2023-03-06T14:16:17.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.326+0000 7fa1ba884700 1 -- 172.21.15.3:0/60827159 learned_addr learned my addr 172.21.15.3:0/60827159 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:17.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.326+0000 7fa1ba083700 1 --2- 172.21.15.3:0/60827159 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1b406ea70 0x7fa1b40bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:17.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.326+0000 7fa1b9882700 1 --2- 172.21.15.3:0/60827159 >> v2:172.21.15.136:3300/0 conn(0x7fa1b406ee40 0x7fa1b41490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:17.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.326+0000 7fa1b9081700 1 -- 172.21.15.3:0/60827159 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 870553068 0 0) 0x7fa1b414ff80 con 0x7fa1b40bdd60 2023-03-06T14:16:17.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.326+0000 7fa1b9081700 1 -- 172.21.15.3:0/60827159 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1a00035b0 con 0x7fa1b40bdd60 2023-03-06T14:16:17.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1b9081700 1 -- 172.21.15.3:0/60827159 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3782178223 0 0) 0x7fa1a00035b0 con 0x7fa1b40bdd60 2023-03-06T14:16:17.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1b9081700 1 -- 172.21.15.3:0/60827159 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1b406ea70 msgr2=0x7fa1b40bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:17.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1b9081700 1 --2- 172.21.15.3:0/60827159 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1b406ea70 0x7fa1b40bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1b9081700 1 -- 172.21.15.3:0/60827159 >> v2:172.21.15.136:3300/0 conn(0x7fa1b406ee40 msgr2=0x7fa1b41490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:17.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1b9081700 1 --2- 172.21.15.3:0/60827159 >> v2:172.21.15.136:3300/0 conn(0x7fa1b406ee40 0x7fa1b41490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1b9081700 1 -- 172.21.15.3:0/60827159 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b40bce70 con 0x7fa1b40bdd60 2023-03-06T14:16:17.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1b9081700 1 -- 172.21.15.3:0/60827159 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3255535284 0 0) 0x7fa1ac0019f0 con 0x7fa1b40bdd60 2023-03-06T14:16:17.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1b9081700 1 -- 172.21.15.3:0/60827159 >> v1:172.21.15.3:6789/0 conn(0x7fa1b40bdd60 legacy=0x7fa1b406c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:17.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1b9081700 1 --2- 172.21.15.3:0/60827159 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1b406ea70 0x7fa1a0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:17.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1b9081700 1 --2- 172.21.15.3:0/60827159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1a0003f80 0x7fa1a0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:17.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1b9081700 1 --2- 172.21.15.3:0/60827159 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1a0004d90 0x7fa1a0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:17.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1b9081700 1 -- 172.21.15.3:0/60827159 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b40bcb90 con 0x7fa1a0003f80 2023-03-06T14:16:17.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1b9081700 1 -- 172.21.15.3:0/60827159 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a000ba10 con 0x7fa1a0004d90 2023-03-06T14:16:17.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1b9081700 1 -- 172.21.15.3:0/60827159 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a000bb50 con 0x7fa1b406ea70 2023-03-06T14:16:17.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1b9882700 1 --2- 172.21.15.3:0/60827159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1a0003f80 0x7fa1a0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:17.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1ba083700 1 --2- 172.21.15.3:0/60827159 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1b406ea70 0x7fa1a0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:17.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1ba884700 1 --2- 172.21.15.3:0/60827159 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1a0004d90 0x7fa1a0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:17.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1ba083700 1 -- 172.21.15.3:0/60827159 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1a0004d90 msgr2=0x7fa1a0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:17.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1ba083700 1 --2- 172.21.15.3:0/60827159 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1a0004d90 0x7fa1a0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1ba083700 1 -- 172.21.15.3:0/60827159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1a0003f80 msgr2=0x7fa1a0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:17.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1ba083700 1 --2- 172.21.15.3:0/60827159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1a0003f80 0x7fa1a0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1ba083700 1 -- 172.21.15.3:0/60827159 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a00035b0 con 0x7fa1b406ea70 2023-03-06T14:16:17.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1b9882700 1 --2- 172.21.15.3:0/60827159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1a0003f80 0x7fa1a0004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:16:17.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.327+0000 7fa1ba083700 1 --2- 172.21.15.3:0/60827159 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1b406ea70 0x7fa1a0003a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009b40 tx=0x7fa1a0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7ec632301135126 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:17.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.328+0000 7fa1b9081700 1 -- 172.21.15.3:0/60827159 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4005a20 con 0x7fa1b406ea70 2023-03-06T14:16:17.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.328+0000 7fa1b9081700 1 -- 172.21.15.3:0/60827159 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a4005b80 con 0x7fa1b406ea70 2023-03-06T14:16:17.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.328+0000 7fa1b9081700 1 -- 172.21.15.3:0/60827159 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a400e6c0 con 0x7fa1b406ea70 2023-03-06T14:16:17.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.328+0000 7fa1bc2e7700 1 -- 172.21.15.3:0/60827159 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1b406ea70 msgr2=0x7fa1a0003a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:17.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.328+0000 7fa1bc2e7700 1 --2- 172.21.15.3:0/60827159 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1b406ea70 0x7fa1a0003a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009b40 tx=0x7fa1a0005880 comp rx=0 tx=0).stop 2023-03-06T14:16:17.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.328+0000 7fa1ba884700 1 -- 172.21.15.3:0/60827159 reap_dead start 2023-03-06T14:16:17.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.328+0000 7fa1bc2e7700 1 -- 172.21.15.3:0/60827159 shutdown_connections 2023-03-06T14:16:17.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.328+0000 7fa1bc2e7700 1 -- 172.21.15.3:0/60827159 >> 172.21.15.3:0/60827159 conn(0x7fa1b40c2150 msgr2=0x7fa1b40c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:17.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.328+0000 7fa1bc2e7700 1 -- 172.21.15.3:0/60827159 shutdown_connections 2023-03-06T14:16:17.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.328+0000 7fa1bc2e7700 1 -- 172.21.15.3:0/60827159 wait complete. 2023-03-06T14:16:17.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.329+0000 7fa1bc2e7700 1 Processor -- start 2023-03-06T14:16:17.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.329+0000 7fa1bc2e7700 1 -- start start 2023-03-06T14:16:17.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.330+0000 7fa1bc2e7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1b406ea70 0x7fa1b41e51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:17.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.330+0000 7fa1bc2e7700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1b40bbd30 0x7fa1b4151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:17.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.330+0000 7fa1bc2e7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1b4151bc0 0x7fa1b40a7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:17.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.330+0000 7fa1bc2e7700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b4152f70 con 0x7fa1b406ea70 2023-03-06T14:16:17.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.330+0000 7fa1bc2e7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b41511f0 con 0x7fa1b4151bc0 2023-03-06T14:16:17.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.330+0000 7fa1bc2e7700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b41e56f0 con 0x7fa1b40bbd30 2023-03-06T14:16:17.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.330+0000 7fa1ba083700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1b406ea70 0x7fa1b41e51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:17.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.330+0000 7fa1ba083700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1b406ea70 0x7fa1b41e51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55986/0 (socket says 172.21.15.3:55986) 2023-03-06T14:16:17.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.330+0000 7fa1ba083700 1 -- 172.21.15.3:0/2735798858 learned_addr learned my addr 172.21.15.3:0/2735798858 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:17.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.330+0000 7fa1ba884700 1 --2- 172.21.15.3:0/2735798858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1b4151bc0 0x7fa1b40a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:17.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.330+0000 7fa1b9882700 1 --2- 172.21.15.3:0/2735798858 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1b40bbd30 0x7fa1b4151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:17.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.330+0000 7fa1ba083700 1 -- 172.21.15.3:0/2735798858 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1b40bbd30 msgr2=0x7fa1b4151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:17.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.330+0000 7fa1ba083700 1 --2- 172.21.15.3:0/2735798858 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1b40bbd30 0x7fa1b4151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.330+0000 7fa1ba083700 1 -- 172.21.15.3:0/2735798858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1b4151bc0 msgr2=0x7fa1b40a7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:17.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.330+0000 7fa1ba083700 1 --2- 172.21.15.3:0/2735798858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1b4151bc0 0x7fa1b40a7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.330+0000 7fa1ba083700 1 -- 172.21.15.3:0/2735798858 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b4150220 con 0x7fa1b406ea70 2023-03-06T14:16:17.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.330+0000 7fa1b9882700 1 --2- 172.21.15.3:0/2735798858 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1b40bbd30 0x7fa1b4151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:16:17.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.330+0000 7fa1ba884700 1 --2- 172.21.15.3:0/2735798858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1b4151bc0 0x7fa1b40a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:16:17.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.331+0000 7fa1ba083700 1 --2- 172.21.15.3:0/2735798858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1b406ea70 0x7fa1b41e51b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400ff40 tx=0x7fa1a40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:17.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.331+0000 7fa1aaffd700 1 -- 172.21.15.3:0/2735798858 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4020070 con 0x7fa1b406ea70 2023-03-06T14:16:17.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.331+0000 7fa1aaffd700 1 -- 172.21.15.3:0/2735798858 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a4005e30 con 0x7fa1b406ea70 2023-03-06T14:16:17.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.331+0000 7fa1bc2e7700 1 -- 172.21.15.3:0/2735798858 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b40bd150 con 0x7fa1b406ea70 2023-03-06T14:16:17.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.331+0000 7fa1aaffd700 1 -- 172.21.15.3:0/2735798858 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4004480 con 0x7fa1b406ea70 2023-03-06T14:16:17.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.331+0000 7fa1bc2e7700 1 -- 172.21.15.3:0/2735798858 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b40b8b80 con 0x7fa1b406ea70 2023-03-06T14:16:17.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.332+0000 7fa1bc2e7700 1 -- 172.21.15.3:0/2735798858 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b41527a0 con 0x7fa1b406ea70 2023-03-06T14:16:17.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.332+0000 7fa1aaffd700 1 -- 172.21.15.3:0/2735798858 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa1a402b030 con 0x7fa1b406ea70 2023-03-06T14:16:17.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.332+0000 7fa1aaffd700 1 --2- 172.21.15.3:0/2735798858 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa1980682f0 0x7fa19806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:17.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.333+0000 7fa1aaffd700 1 -- 172.21.15.3:0/2735798858 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa1a4086f20 con 0x7fa1b406ea70 2023-03-06T14:16:17.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.333+0000 7fa1b9882700 1 --2- 172.21.15.3:0/2735798858 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa1980682f0 0x7fa19806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:17.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.333+0000 7fa1b9882700 1 --2- 172.21.15.3:0/2735798858 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa1980682f0 0x7fa19806a7a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa1b41e2360 tx=0x7fa1b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:17.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.337+0000 7fa1aaffd700 1 -- 172.21.15.3:0/2735798858 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa1a40b85e0 con 0x7fa1b406ea70 2023-03-06T14:16:17.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.574+0000 7fa1bc2e7700 1 -- 172.21.15.3:0/2735798858 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1b4152f70 con 0x7fa1b406ea70 2023-03-06T14:16:17.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.575+0000 7fa1aaffd700 1 -- 172.21.15.3:0/2735798858 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4644 (secure 0 0 0) 0x7fa1a4053540 con 0x7fa1b406ea70 2023-03-06T14:16:17.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:17.577 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/3666647721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3666647721},{"type":"v1","addr":"172.21.15.136:6835","nonce":3666647721}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6834/1347040159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":1347040159},{"type":"v1","addr":"172.21.15.3:6834","nonce":1347040159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2387644382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2387644382},{"type":"v1","addr":"172.21.15.136:6837","nonce":2387644382}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-06T14:15:58.597248+0000","modified":"2023-03-06T14:16:17.169107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6835/3655666630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6833","nonce":3655666630},{"type":"v1","addr":"172.21.15.3:6835","nonce":3655666630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-06T14:16:17.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.576+0000 7fa1bc2e7700 1 -- 172.21.15.3:0/2735798858 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa1980682f0 msgr2=0x7fa19806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:17.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.576+0000 7fa1bc2e7700 1 --2- 172.21.15.3:0/2735798858 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa1980682f0 0x7fa19806a7a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa1b41e2360 tx=0x7fa1b0008040 comp rx=0 tx=0).stop 2023-03-06T14:16:17.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.577+0000 7fa1bc2e7700 1 -- 172.21.15.3:0/2735798858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1b406ea70 msgr2=0x7fa1b41e51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:17.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.577+0000 7fa1bc2e7700 1 --2- 172.21.15.3:0/2735798858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1b406ea70 0x7fa1b41e51b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400ff40 tx=0x7fa1a40047c0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.577+0000 7fa1bc2e7700 1 -- 172.21.15.3:0/2735798858 shutdown_connections 2023-03-06T14:16:17.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.577+0000 7fa1bc2e7700 1 --2- 172.21.15.3:0/2735798858 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa1980682f0 0x7fa19806a7a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.577+0000 7fa1bc2e7700 1 --2- 172.21.15.3:0/2735798858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1b406ea70 0x7fa1b41e51b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.577+0000 7fa1bc2e7700 1 --2- 172.21.15.3:0/2735798858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1b4151bc0 0x7fa1b40a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.577+0000 7fa1bc2e7700 1 --2- 172.21.15.3:0/2735798858 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1b40bbd30 0x7fa1b4151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.577+0000 7fa1bc2e7700 1 -- 172.21.15.3:0/2735798858 >> 172.21.15.3:0/2735798858 conn(0x7fa1b40c2150 msgr2=0x7fa1b406cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:17.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.577+0000 7fa1bc2e7700 1 -- 172.21.15.3:0/2735798858 shutdown_connections 2023-03-06T14:16:17.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.577+0000 7fa1bc2e7700 1 -- 172.21.15.3:0/2735798858 wait complete. 2023-03-06T14:16:17.580 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 9 2023-03-06T14:16:17.590 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T14:16:17.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.714+0000 7f4e3e234700 1 Processor -- start 2023-03-06T14:16:17.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.714+0000 7f4e3e234700 1 -- start start 2023-03-06T14:16:17.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e3e234700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4e38146130 0x7f4e3814f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:17.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e3e234700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e380b8140 0x7f4e3806e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:17.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e3e234700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4e3806edd0 0x7f4e3806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:17.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e3e234700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3814fab0 con 0x7f4e38146130 2023-03-06T14:16:17.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e3e234700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3806fc80 con 0x7f4e3806edd0 2023-03-06T14:16:17.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e3e234700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3814cb30 con 0x7f4e380b8140 2023-03-06T14:16:17.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e377fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4e38146130 0x7f4e3814f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:17.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e377fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4e38146130 0x7f4e3814f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55994/0 (socket says 172.21.15.3:55994) 2023-03-06T14:16:17.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e377fe700 1 -- 172.21.15.3:0/1857927589 learned_addr learned my addr 172.21.15.3:0/1857927589 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:17.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e37fff700 1 --2- 172.21.15.3:0/1857927589 >> v2:172.21.15.136:3300/0 conn(0x7f4e3806edd0 0x7f4e3806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:17.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e36ffd700 1 --2- 172.21.15.3:0/1857927589 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e380b8140 0x7f4e3806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:17.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e377fe700 1 -- 172.21.15.3:0/1857927589 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e380b8140 msgr2=0x7f4e3806e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:17.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e377fe700 1 --2- 172.21.15.3:0/1857927589 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e380b8140 0x7f4e3806e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e377fe700 1 -- 172.21.15.3:0/1857927589 >> v2:172.21.15.136:3300/0 conn(0x7f4e3806edd0 msgr2=0x7f4e3806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:17.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e377fe700 1 --2- 172.21.15.3:0/1857927589 >> v2:172.21.15.136:3300/0 conn(0x7f4e3806edd0 0x7f4e3806bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e377fe700 1 -- 172.21.15.3:0/1857927589 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3806f520 con 0x7f4e38146130 2023-03-06T14:16:17.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e377fe700 1 --2- 172.21.15.3:0/1857927589 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e38146130 0x7f4e3814f570 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4e3806d600 tx=0x7f4e2800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627c1bfcfa343b66 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:17.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e367fc700 1 -- 172.21.15.3:0/1857927589 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28005e30 con 0x7f4e38146130 2023-03-06T14:16:17.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e367fc700 1 -- 172.21.15.3:0/1857927589 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e28004030 con 0x7f4e38146130 2023-03-06T14:16:17.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.715+0000 7f4e367fc700 1 -- 172.21.15.3:0/1857927589 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e280043e0 con 0x7f4e38146130 2023-03-06T14:16:17.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.716+0000 7f4e3e234700 1 -- 172.21.15.3:0/1857927589 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e38146130 msgr2=0x7f4e3814f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:17.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.716+0000 7f4e3e234700 1 --2- 172.21.15.3:0/1857927589 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e38146130 0x7f4e3814f570 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4e3806d600 tx=0x7f4e2800be70 comp rx=0 tx=0).stop 2023-03-06T14:16:17.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.716+0000 7f4e3e234700 1 -- 172.21.15.3:0/1857927589 shutdown_connections 2023-03-06T14:16:17.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.716+0000 7f4e3e234700 1 --2- 172.21.15.3:0/1857927589 >> v2:172.21.15.136:3300/0 conn(0x7f4e3806edd0 0x7f4e3806bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.716+0000 7f4e3e234700 1 --2- 172.21.15.3:0/1857927589 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e38146130 0x7f4e3814f570 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.716+0000 7f4e3e234700 1 --2- 172.21.15.3:0/1857927589 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e380b8140 0x7f4e3806e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.716+0000 7f4e3e234700 1 -- 172.21.15.3:0/1857927589 >> 172.21.15.3:0/1857927589 conn(0x7f4e380c2150 msgr2=0x7f4e380c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:17.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.716+0000 7f4e3e234700 1 -- 172.21.15.3:0/1857927589 shutdown_connections 2023-03-06T14:16:17.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.716+0000 7f4e3e234700 1 -- 172.21.15.3:0/1857927589 wait complete. 2023-03-06T14:16:17.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.717+0000 7f4e3e234700 1 Processor -- start 2023-03-06T14:16:17.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.717+0000 7f4e3e234700 1 -- start start 2023-03-06T14:16:17.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.718+0000 7f4e3e234700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e3806edd0 0x7f4e381e18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:17.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.718+0000 7f4e3e234700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e380b8140 0x7f4e3814e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:17.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.718+0000 7f4e3e234700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e38146130 0x7f4e38147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:17.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.718+0000 7f4e3e234700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e381d8100 con 0x7f4e380b8140 2023-03-06T14:16:17.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.718+0000 7f4e3e234700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e38147280 con 0x7f4e38146130 2023-03-06T14:16:17.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.718+0000 7f4e3e234700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e38149070 con 0x7f4e3806edd0 2023-03-06T14:16:17.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.718+0000 7f4e36ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e380b8140 0x7f4e3814e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:17.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.718+0000 7f4e36ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e380b8140 0x7f4e3814e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56002/0 (socket says 172.21.15.3:56002) 2023-03-06T14:16:17.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.718+0000 7f4e36ffd700 1 -- 172.21.15.3:0/1553403056 learned_addr learned my addr 172.21.15.3:0/1553403056 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:17.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.718+0000 7f4e37fff700 1 --2- 172.21.15.3:0/1553403056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e38146130 0x7f4e38147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:17.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.718+0000 7f4e377fe700 1 --2- 172.21.15.3:0/1553403056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e3806edd0 0x7f4e381e18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:17.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.718+0000 7f4e36ffd700 1 -- 172.21.15.3:0/1553403056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e3806edd0 msgr2=0x7f4e381e18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:17.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.718+0000 7f4e36ffd700 1 --2- 172.21.15.3:0/1553403056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e3806edd0 0x7f4e381e18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.718+0000 7f4e36ffd700 1 -- 172.21.15.3:0/1553403056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e38146130 msgr2=0x7f4e38147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:17.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.718+0000 7f4e36ffd700 1 --2- 172.21.15.3:0/1553403056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e38146130 0x7f4e38147b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.718+0000 7f4e36ffd700 1 -- 172.21.15.3:0/1553403056 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2800b7a0 con 0x7f4e380b8140 2023-03-06T14:16:17.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.718+0000 7f4e37fff700 1 --2- 172.21.15.3:0/1553403056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e38146130 0x7f4e38147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:16:17.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.719+0000 7f4e36ffd700 1 --2- 172.21.15.3:0/1553403056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e380b8140 0x7f4e3814e610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00e9b0 tx=0x7f4e2c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:17.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.719+0000 7f4e1ffff700 1 -- 172.21.15.3:0/1553403056 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c009710 con 0x7f4e380b8140 2023-03-06T14:16:17.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.719+0000 7f4e1ffff700 1 -- 172.21.15.3:0/1553403056 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c00c850 con 0x7f4e380b8140 2023-03-06T14:16:17.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.719+0000 7f4e3e234700 1 -- 172.21.15.3:0/1553403056 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e380b8870 con 0x7f4e380b8140 2023-03-06T14:16:17.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.719+0000 7f4e1ffff700 1 -- 172.21.15.3:0/1553403056 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c00cbc0 con 0x7f4e380b8140 2023-03-06T14:16:17.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.719+0000 7f4e3e234700 1 -- 172.21.15.3:0/1553403056 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3806f9a0 con 0x7f4e380b8140 2023-03-06T14:16:17.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.720+0000 7f4e3e234700 1 -- 172.21.15.3:0/1553403056 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e380b8b50 con 0x7f4e380b8140 2023-03-06T14:16:17.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.721+0000 7f4e1ffff700 1 -- 172.21.15.3:0/1553403056 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4e2c019030 con 0x7f4e380b8140 2023-03-06T14:16:17.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.721+0000 7f4e1ffff700 1 --2- 172.21.15.3:0/1553403056 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f4e24068320 0x7f4e2406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:17.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.721+0000 7f4e1ffff700 1 -- 172.21.15.3:0/1553403056 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4e2c086620 con 0x7f4e380b8140 2023-03-06T14:16:17.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.721+0000 7f4e377fe700 1 --2- 172.21.15.3:0/1553403056 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f4e24068320 0x7f4e2406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:17.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.722+0000 7f4e377fe700 1 --2- 172.21.15.3:0/1553403056 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f4e24068320 0x7f4e2406a7d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4e28000c00 tx=0x7f4e2801b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:17.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.724+0000 7f4e1ffff700 1 -- 172.21.15.3:0/1553403056 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4e2c056660 con 0x7f4e380b8140 2023-03-06T14:16:17.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.919+0000 7f4e3e234700 1 -- 172.21.15.3:0/1553403056 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e381491e0 con 0x7f4e380b8140 2023-03-06T14:16:17.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.921+0000 7f4e1ffff700 1 -- 172.21.15.3:0/1553403056 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19604 (secure 0 0 0) 0x7f4e2c056250 con 0x7f4e380b8140 2023-03-06T14:16:17.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:17.922 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":27,"fsid":"9aae2361-5af0-49eb-8f99-e7f69834fedf","created":"2023-03-06T14:15:33.357348+0000","modified":"2023-03-06T14:16:03.040402+0000","last_up_change":"2023-03-06T14:15:44.374764+0000","last_in_change":"2023-03-06T14:15:35.866803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T14:15:45.023761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T14:15:51.830917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-06T14:15:56.256188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-06T14:15:57.571429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-06T14:16:00.645210+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c92c9e49-8a23-48a5-87e5-51f184f73a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":96679},{"type":"v1","addr":"172.21.15.3:6809","nonce":96679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":96679},{"type":"v1","addr":"172.21.15.3:6811","nonce":96679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":96679},{"type":"v1","addr":"172.21.15.3:6818","nonce":96679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":96679},{"type":"v1","addr":"172.21.15.3:6814","nonce":96679}]},"public_addr":"172.21.15.3:6809/96679","cluster_addr":"172.21.15.3:6811/96679","heartbeat_back_addr":"172.21.15.3:6818/96679","heartbeat_front_addr":"172.21.15.3:6814/96679","state":["exists","up"]},{"osd":1,"uuid":"86ec9127-843f-4246-bfbe-e14ce3af7d17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":96681},{"type":"v1","addr":"172.21.15.3:6825","nonce":96681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":96681},{"type":"v1","addr":"172.21.15.3:6827","nonce":96681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":96681},{"type":"v1","addr":"172.21.15.3:6831","nonce":96681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":96681},{"type":"v1","addr":"172.21.15.3:6829","nonce":96681}]},"public_addr":"172.21.15.3:6825/96681","cluster_addr":"172.21.15.3:6827/96681","heartbeat_back_addr":"172.21.15.3:6831/96681","heartbeat_front_addr":"172.21.15.3:6829/96681","state":["exists","up"]},{"osd":2,"uuid":"67582de3-0f75-4cf0-84ca-e878986f99f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":96682},{"type":"v1","addr":"172.21.15.3:6815","nonce":96682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6817","nonce":96682},{"type":"v1","addr":"172.21.15.3:6819","nonce":96682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":96682},{"type":"v1","addr":"172.21.15.3:6823","nonce":96682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":96682},{"type":"v1","addr":"172.21.15.3:6821","nonce":96682}]},"public_addr":"172.21.15.3:6815/96682","cluster_addr":"172.21.15.3:6819/96682","heartbeat_back_addr":"172.21.15.3:6823/96682","heartbeat_front_addr":"172.21.15.3:6821/96682","state":["exists","up"]},{"osd":3,"uuid":"0fb8d708-4b38-4153-8a60-79741765d439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":96680},{"type":"v1","addr":"172.21.15.3:6801","nonce":96680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":96680},{"type":"v1","addr":"172.21.15.3:6803","nonce":96680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":96680},{"type":"v1","addr":"172.21.15.3:6807","nonce":96680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":96680},{"type":"v1","addr":"172.21.15.3:6805","nonce":96680}]},"public_addr":"172.21.15.3:6801/96680","cluster_addr":"172.21.15.3:6803/96680","heartbeat_back_addr":"172.21.15.3:6807/96680","heartbeat_front_addr":"172.21.15.3:6805/96680","state":["exists","up"]},{"osd":4,"uuid":"44eb9d99-975f-43a3-8bf4-213b2ba6dea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":96798},{"type":"v1","addr":"172.21.15.136:6822","nonce":96798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":96798},{"type":"v1","addr":"172.21.15.136:6826","nonce":96798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":96798},{"type":"v1","addr":"172.21.15.136:6831","nonce":96798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":96798},{"type":"v1","addr":"172.21.15.136:6829","nonce":96798}]},"public_addr":"172.21.15.136:6822/96798","cluster_addr":"172.21.15.136:6826/96798","heartbeat_back_addr":"172.21.15.136:6831/96798","heartbeat_front_addr":"172.21.15.136:6829/96798","state":["exists","up"]},{"osd":5,"uuid":"aff1a438-c444-4ebc-9806-d2d117878a2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":96796},{"type":"v1","addr":"172.21.15.136:6804","nonce":96796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":96796},{"type":"v1","addr":"172.21.15.136:6809","nonce":96796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":96796},{"type":"v1","addr":"172.21.15.136:6815","nonce":96796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":96796},{"type":"v1","addr":"172.21.15.136:6813","nonce":96796}]},"public_addr":"172.21.15.136:6804/96796","cluster_addr":"172.21.15.136:6809/96796","heartbeat_back_addr":"172.21.15.136:6815/96796","heartbeat_front_addr":"172.21.15.136:6813/96796","state":["exists","up"]},{"osd":6,"uuid":"89cc219c-f57b-43f4-8e54-76017dd4930d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":96797},{"type":"v1","addr":"172.21.15.136:6801","nonce":96797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6803","nonce":96797},{"type":"v1","addr":"172.21.15.136:6805","nonce":96797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":96797},{"type":"v1","addr":"172.21.15.136:6811","nonce":96797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":96797},{"type":"v1","addr":"172.21.15.136:6808","nonce":96797}]},"public_addr":"172.21.15.136:6801/96797","cluster_addr":"172.21.15.136:6805/96797","heartbeat_back_addr":"172.21.15.136:6811/96797","heartbeat_front_addr":"172.21.15.136:6808/96797","state":["exists","up"]},{"osd":7,"uuid":"a90e4c14-00de-4d1c-92ce-9f20df714e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":96819},{"type":"v1","addr":"172.21.15.136:6817","nonce":96819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":96819},{"type":"v1","addr":"172.21.15.136:6819","nonce":96819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":96819},{"type":"v1","addr":"172.21.15.136:6827","nonce":96819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":96819},{"type":"v1","addr":"172.21.15.136:6823","nonce":96819}]},"public_addr":"172.21.15.136:6817/96819","cluster_addr":"172.21.15.136:6819/96819","heartbeat_back_addr":"172.21.15.136:6827/96819","heartbeat_front_addr":"172.21.15.136:6823/96819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.093141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.034488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.128137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.097924+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.045441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.005820+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.039918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.082053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T14:16:17.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.922+0000 7f4e3e234700 1 -- 172.21.15.3:0/1553403056 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f4e24068320 msgr2=0x7f4e2406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:17.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.922+0000 7f4e3e234700 1 --2- 172.21.15.3:0/1553403056 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f4e24068320 0x7f4e2406a7d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4e28000c00 tx=0x7f4e2801b040 comp rx=0 tx=0).stop 2023-03-06T14:16:17.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.922+0000 7f4e3e234700 1 -- 172.21.15.3:0/1553403056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e380b8140 msgr2=0x7f4e3814e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:17.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.922+0000 7f4e3e234700 1 --2- 172.21.15.3:0/1553403056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e380b8140 0x7f4e3814e610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00e9b0 tx=0x7f4e2c00ed70 comp rx=0 tx=0).stop 2023-03-06T14:16:17.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.923+0000 7f4e3e234700 1 -- 172.21.15.3:0/1553403056 shutdown_connections 2023-03-06T14:16:17.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.923+0000 7f4e3e234700 1 --2- 172.21.15.3:0/1553403056 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f4e24068320 0x7f4e2406a7d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.923+0000 7f4e3e234700 1 --2- 172.21.15.3:0/1553403056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e38146130 0x7f4e38147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.923+0000 7f4e3e234700 1 --2- 172.21.15.3:0/1553403056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4e3806edd0 0x7f4e381e18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.923+0000 7f4e3e234700 1 --2- 172.21.15.3:0/1553403056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e380b8140 0x7f4e3814e610 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:17.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.923+0000 7f4e3e234700 1 -- 172.21.15.3:0/1553403056 >> 172.21.15.3:0/1553403056 conn(0x7f4e380c2150 msgr2=0x7f4e380b77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:17.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.923+0000 7f4e3e234700 1 -- 172.21.15.3:0/1553403056 shutdown_connections 2023-03-06T14:16:17.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:17.923+0000 7f4e3e234700 1 -- 172.21.15.3:0/1553403056 wait complete. 2023-03-06T14:16:17.936 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-03-06T14:16:17.937 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-06T14:16:18.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.059+0000 7f2106438700 1 Processor -- start 2023-03-06T14:16:18.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.060+0000 7f2106438700 1 -- start start 2023-03-06T14:16:18.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.060+0000 7f2106438700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f210006ea70 0x7f21000bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:18.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.060+0000 7f2106438700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f210006ee40 0x7f21001490f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:18.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.060+0000 7f2106438700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f210014ff80 con 0x7f21000bdd60 2023-03-06T14:16:18.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.060+0000 7f2106438700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21000b9070 con 0x7f210006ee40 2023-03-06T14:16:18.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.060+0000 7f2106438700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21000bcb90 con 0x7f210006ea70 2023-03-06T14:16:18.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.061+0000 7f20ff7fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f210006ee40 0x7f21001490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:18.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.061+0000 7f20fffff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f210006ea70 0x7f21000bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:18.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.061+0000 7f20ff7fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f210006ee40 0x7f21001490f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.3:42098/0 (socket says 172.21.15.3:42098) 2023-03-06T14:16:18.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.061+0000 7f21049d5700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f21000bdd60 0x7f210006c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.3:55770/0 (socket says 172.21.15.3:55770) 2023-03-06T14:16:18.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.061+0000 7f20ff7fe700 1 -- 172.21.15.3:0/3422380113 learned_addr learned my addr 172.21.15.3:0/3422380113 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:18.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.061+0000 7f20feffd700 1 -- 172.21.15.3:0/3422380113 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638276801 0 0) 0x7f210014ff80 con 0x7f21000bdd60 2023-03-06T14:16:18.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.061+0000 7f20feffd700 1 -- 172.21.15.3:0/3422380113 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20e80035b0 con 0x7f21000bdd60 2023-03-06T14:16:18.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.061+0000 7f20fffff700 1 -- 172.21.15.3:0/3422380113 >> v2:172.21.15.136:3300/0 conn(0x7f210006ee40 msgr2=0x7f21001490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:18.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.061+0000 7f20fffff700 1 --2- 172.21.15.3:0/3422380113 >> v2:172.21.15.136:3300/0 conn(0x7f210006ee40 0x7f21001490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.061+0000 7f20fffff700 1 -- 172.21.15.3:0/3422380113 >> v1:172.21.15.136:6789/0 conn(0x7f21000bdd60 legacy=0x7f210006c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:18.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.061+0000 7f20fffff700 1 -- 172.21.15.3:0/3422380113 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21000bce70 con 0x7f210006ea70 2023-03-06T14:16:18.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.061+0000 7f20ff7fe700 1 --2- 172.21.15.3:0/3422380113 >> v2:172.21.15.136:3300/0 conn(0x7f210006ee40 0x7f21001490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:16:18.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.061+0000 7f20fffff700 1 --2- 172.21.15.3:0/3422380113 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f210006ea70 0x7f21000bd670 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009820 tx=0x7f20f0009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1258bc48b603721 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:18.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.061+0000 7f20feffd700 1 -- 172.21.15.3:0/3422380113 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f0005e30 con 0x7f210006ea70 2023-03-06T14:16:18.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.061+0000 7f20feffd700 1 -- 172.21.15.3:0/3422380113 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f0006030 con 0x7f210006ea70 2023-03-06T14:16:18.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.061+0000 7f20feffd700 1 -- 172.21.15.3:0/3422380113 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f00063c0 con 0x7f210006ea70 2023-03-06T14:16:18.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.062+0000 7f2106438700 1 -- 172.21.15.3:0/3422380113 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f210006ea70 msgr2=0x7f21000bd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:18.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.062+0000 7f2106438700 1 --2- 172.21.15.3:0/3422380113 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f210006ea70 0x7f21000bd670 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009820 tx=0x7f20f0009b30 comp rx=0 tx=0).stop 2023-03-06T14:16:18.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.062+0000 7f2106438700 1 -- 172.21.15.3:0/3422380113 shutdown_connections 2023-03-06T14:16:18.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.062+0000 7f2106438700 1 --2- 172.21.15.3:0/3422380113 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f210006ea70 0x7f21000bd670 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.062+0000 7f2106438700 1 --2- 172.21.15.3:0/3422380113 >> v2:172.21.15.136:3300/0 conn(0x7f210006ee40 0x7f21001490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.062+0000 7f2106438700 1 -- 172.21.15.3:0/3422380113 >> 172.21.15.3:0/3422380113 conn(0x7f21000c2150 msgr2=0x7f21000c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:18.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.062+0000 7f2106438700 1 -- 172.21.15.3:0/3422380113 shutdown_connections 2023-03-06T14:16:18.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.062+0000 7f2106438700 1 -- 172.21.15.3:0/3422380113 wait complete. 2023-03-06T14:16:18.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.064+0000 7f2106438700 1 Processor -- start 2023-03-06T14:16:18.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.064+0000 7f2106438700 1 -- start start 2023-03-06T14:16:18.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.064+0000 7f2106438700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f210006ea70 0x7f21000bbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:18.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f2106438700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f210006ee40 0x7f21001d8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:18.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f2106438700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21000bdd60 0x7f210014e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:18.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f2106438700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21000bc340 con 0x7f210006ea70 2023-03-06T14:16:18.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f2106438700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210014df70 con 0x7f21000bdd60 2023-03-06T14:16:18.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f2106438700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21001d9390 con 0x7f210006ee40 2023-03-06T14:16:18.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f20fffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f210006ea70 0x7f21000bbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:18.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f20fffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f210006ea70 0x7f21000bbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56014/0 (socket says 172.21.15.3:56014) 2023-03-06T14:16:18.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f20fffff700 1 -- 172.21.15.3:0/4058691190 learned_addr learned my addr 172.21.15.3:0/4058691190 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:18.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f20ff7fe700 1 --2- 172.21.15.3:0/4058691190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f210006ee40 0x7f21001d8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:18.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f21049d5700 1 --2- 172.21.15.3:0/4058691190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21000bdd60 0x7f210014e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:18.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f20fffff700 1 -- 172.21.15.3:0/4058691190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f210006ee40 msgr2=0x7f21001d8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:18.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f20fffff700 1 --2- 172.21.15.3:0/4058691190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f210006ee40 0x7f21001d8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f20fffff700 1 -- 172.21.15.3:0/4058691190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21000bdd60 msgr2=0x7f210014e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:18.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f20fffff700 1 --2- 172.21.15.3:0/4058691190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21000bdd60 0x7f210014e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f20fffff700 1 -- 172.21.15.3:0/4058691190 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f4009550 con 0x7f210006ea70 2023-03-06T14:16:18.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f20fffff700 1 --2- 172.21.15.3:0/4058691190 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f210006ea70 0x7f21000bbe00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f20f0000c00 tx=0x7f20f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:18.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f20fcff9700 1 -- 172.21.15.3:0/4058691190 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f00061a0 con 0x7f210006ea70 2023-03-06T14:16:18.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f20fcff9700 1 -- 172.21.15.3:0/4058691190 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f0020070 con 0x7f210006ea70 2023-03-06T14:16:18.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f2106438700 1 -- 172.21.15.3:0/4058691190 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f0009430 con 0x7f210006ea70 2023-03-06T14:16:18.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.065+0000 7f20fcff9700 1 -- 172.21.15.3:0/4058691190 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f0006560 con 0x7f210006ea70 2023-03-06T14:16:18.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.066+0000 7f2106438700 1 -- 172.21.15.3:0/4058691190 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2100150220 con 0x7f210006ea70 2023-03-06T14:16:18.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.066+0000 7f2106438700 1 -- 172.21.15.3:0/4058691190 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21000bd150 con 0x7f210006ea70 2023-03-06T14:16:18.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.067+0000 7f20fcff9700 1 -- 172.21.15.3:0/4058691190 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f20f002b020 con 0x7f210006ea70 2023-03-06T14:16:18.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.067+0000 7f20fcff9700 1 --2- 172.21.15.3:0/4058691190 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f20ec0682f0 0x7f20ec06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:18.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.067+0000 7f20fcff9700 1 -- 172.21.15.3:0/4058691190 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f20f00874e0 con 0x7f210006ea70 2023-03-06T14:16:18.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.067+0000 7f20ff7fe700 1 --2- 172.21.15.3:0/4058691190 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f20ec0682f0 0x7f20ec06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:18.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.068+0000 7f20ff7fe700 1 --2- 172.21.15.3:0/4058691190 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f20ec0682f0 0x7f20ec06a7a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f21000c0c40 tx=0x7f20f40092c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:18.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.072+0000 7f20fcff9700 1 -- 172.21.15.3:0/4058691190 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f20f00539f0 con 0x7f210006ea70 2023-03-06T14:16:18.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.260+0000 7f2106438700 1 -- 172.21.15.3:0/4058691190 --> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21000b8b80 con 0x7f20ec0682f0 2023-03-06T14:16:18.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.271+0000 7f20fcff9700 1 -- 172.21.15.3:0/4058691190 <== mgr.4107 v2:172.21.15.136:6832/96144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367268 (secure 0 0 0) 0x7f21000b8b80 con 0x7f20ec0682f0 2023-03-06T14:16:18.277 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:18.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.275+0000 7f2106438700 1 -- 172.21.15.3:0/4058691190 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f20ec0682f0 msgr2=0x7f20ec06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:18.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.275+0000 7f2106438700 1 --2- 172.21.15.3:0/4058691190 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f20ec0682f0 0x7f20ec06a7a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f21000c0c40 tx=0x7f20f40092c0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.275+0000 7f2106438700 1 -- 172.21.15.3:0/4058691190 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f210006ea70 msgr2=0x7f21000bbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:18.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.275+0000 7f2106438700 1 --2- 172.21.15.3:0/4058691190 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f210006ea70 0x7f21000bbe00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f20f0000c00 tx=0x7f20f0004750 comp rx=0 tx=0).stop 2023-03-06T14:16:18.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.275+0000 7f2106438700 1 -- 172.21.15.3:0/4058691190 shutdown_connections 2023-03-06T14:16:18.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.275+0000 7f2106438700 1 --2- 172.21.15.3:0/4058691190 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f20ec0682f0 0x7f20ec06a7a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.275+0000 7f2106438700 1 --2- 172.21.15.3:0/4058691190 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f210006ea70 0x7f21000bbe00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.275+0000 7f2106438700 1 --2- 172.21.15.3:0/4058691190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21000bdd60 0x7f210014e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.275+0000 7f2106438700 1 --2- 172.21.15.3:0/4058691190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f210006ee40 0x7f21001d8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.275+0000 7f2106438700 1 -- 172.21.15.3:0/4058691190 >> 172.21.15.3:0/4058691190 conn(0x7f21000c2150 msgr2=0x7f21000c0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:18.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.275+0000 7f2106438700 1 -- 172.21.15.3:0/4058691190 shutdown_connections 2023-03-06T14:16:18.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.275+0000 7f2106438700 1 -- 172.21.15.3:0/4058691190 wait complete. 2023-03-06T14:16:18.284 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-03-06T14:16:18.289 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-03-06T14:16:16.968840+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594896,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67496,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907224,"statfs":{"total":773094113280,"available":773024997376,"internally_reserved":0,"allocated":3579904,"data_stored":2148859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2198,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003417"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633630+0000","last_change":"2023-03-06T14:15:58.616190+0000","last_active":"2023-03-06T14:16:02.633630+0000","last_peered":"2023-03-06T14:16:02.633630+0000","last_clean":"2023-03-06T14:16:02.633630+0000","last_became_active":"2023-03-06T14:15:58.615955+0000","last_became_peered":"2023-03-06T14:15:58.615955+0000","last_unstale":"2023-03-06T14:16:02.633630+0000","last_undegraded":"2023-03-06T14:16:02.633630+0000","last_fullsized":"2023-03-06T14:16:02.633630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:30:51.239540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622862+0000","last_change":"2023-03-06T14:15:58.627806+0000","last_active":"2023-03-06T14:16:02.622862+0000","last_peered":"2023-03-06T14:16:02.622862+0000","last_clean":"2023-03-06T14:16:02.622862+0000","last_became_active":"2023-03-06T14:15:58.627569+0000","last_became_peered":"2023-03-06T14:15:58.627569+0000","last_unstale":"2023-03-06T14:16:02.622862+0000","last_undegraded":"2023-03-06T14:16:02.622862+0000","last_fullsized":"2023-03-06T14:16:02.622862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:11:22.678656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.624921+0000","last_change":"2023-03-06T14:15:58.620909+0000","last_active":"2023-03-06T14:16:02.624921+0000","last_peered":"2023-03-06T14:16:02.624921+0000","last_clean":"2023-03-06T14:16:02.624921+0000","last_became_active":"2023-03-06T14:15:58.620552+0000","last_became_peered":"2023-03-06T14:15:58.620552+0000","last_unstale":"2023-03-06T14:16:02.624921+0000","last_undegraded":"2023-03-06T14:16:02.624921+0000","last_fullsized":"2023-03-06T14:16:02.624921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:20:36.299681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.627858+0000","last_change":"2023-03-06T14:15:58.620841+0000","last_active":"2023-03-06T14:16:02.627858+0000","last_peered":"2023-03-06T14:16:02.627858+0000","last_clean":"2023-03-06T14:16:02.627858+0000","last_became_active":"2023-03-06T14:15:58.620520+0000","last_became_peered":"2023-03-06T14:15:58.620520+0000","last_unstale":"2023-03-06T14:16:02.627858+0000","last_undegraded":"2023-03-06T14:16:02.627858+0000","last_fullsized":"2023-03-06T14:16:02.627858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:48:05.347666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.634738+0000","last_change":"2023-03-06T14:15:58.617864+0000","last_active":"2023-03-06T14:16:02.634738+0000","last_peered":"2023-03-06T14:16:02.634738+0000","last_clean":"2023-03-06T14:16:02.634738+0000","last_became_active":"2023-03-06T14:15:58.617583+0000","last_became_peered":"2023-03-06T14:15:58.617583+0000","last_unstale":"2023-03-06T14:16:02.634738+0000","last_undegraded":"2023-03-06T14:16:02.634738+0000","last_fullsized":"2023-03-06T14:16:02.634738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:38.013992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623747+0000","last_change":"2023-03-06T14:15:58.622023+0000","last_active":"2023-03-06T14:16:02.623747+0000","last_peered":"2023-03-06T14:16:02.623747+0000","last_clean":"2023-03-06T14:16:02.623747+0000","last_became_active":"2023-03-06T14:15:58.621701+0000","last_became_peered":"2023-03-06T14:15:58.621701+0000","last_unstale":"2023-03-06T14:16:02.623747+0000","last_undegraded":"2023-03-06T14:16:02.623747+0000","last_fullsized":"2023-03-06T14:16:02.623747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:30:29.679092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633939+0000","last_change":"2023-03-06T14:15:58.628504+0000","last_active":"2023-03-06T14:16:02.633939+0000","last_peered":"2023-03-06T14:16:02.633939+0000","last_clean":"2023-03-06T14:16:02.633939+0000","last_became_active":"2023-03-06T14:15:58.625498+0000","last_became_peered":"2023-03-06T14:15:58.625498+0000","last_unstale":"2023-03-06T14:16:02.633939+0000","last_undegraded":"2023-03-06T14:16:02.633939+0000","last_fullsized":"2023-03-06T14:16:02.633939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621014+0000","last_change":"2023-03-06T14:15:58.623919+0000","last_active":"2023-03-06T14:16:02.621014+0000","last_peered":"2023-03-06T14:16:02.621014+0000","last_clean":"2023-03-06T14:16:02.621014+0000","last_became_active":"2023-03-06T14:15:58.623649+0000","last_became_peered":"2023-03-06T14:15:58.623649+0000","last_unstale":"2023-03-06T14:16:02.621014+0000","last_undegraded":"2023-03-06T14:16:02.621014+0000","last_fullsized":"2023-03-06T14:16:02.621014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633659+0000","last_change":"2023-03-06T14:15:58.620112+0000","last_active":"2023-03-06T14:16:02.633659+0000","last_peered":"2023-03-06T14:16:02.633659+0000","last_clean":"2023-03-06T14:16:02.633659+0000","last_became_active":"2023-03-06T14:15:58.619883+0000","last_became_peered":"2023-03-06T14:15:58.619883+0000","last_unstale":"2023-03-06T14:16:02.633659+0000","last_undegraded":"2023-03-06T14:16:02.633659+0000","last_fullsized":"2023-03-06T14:16:02.633659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:37:30.914574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622801+0000","last_change":"2023-03-06T14:15:58.621910+0000","last_active":"2023-03-06T14:16:02.622801+0000","last_peered":"2023-03-06T14:16:02.622801+0000","last_clean":"2023-03-06T14:16:02.622801+0000","last_became_active":"2023-03-06T14:15:58.621587+0000","last_became_peered":"2023-03-06T14:15:58.621587+0000","last_unstale":"2023-03-06T14:16:02.622801+0000","last_undegraded":"2023-03-06T14:16:02.622801+0000","last_fullsized":"2023-03-06T14:16:02.622801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:38.013992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.624901+0000","last_change":"2023-03-06T14:15:58.624755+0000","last_active":"2023-03-06T14:16:02.624901+0000","last_peered":"2023-03-06T14:16:02.624901+0000","last_clean":"2023-03-06T14:16:02.624901+0000","last_became_active":"2023-03-06T14:15:58.624475+0000","last_became_peered":"2023-03-06T14:15:58.624475+0000","last_unstale":"2023-03-06T14:16:02.624901+0000","last_undegraded":"2023-03-06T14:16:02.624901+0000","last_fullsized":"2023-03-06T14:16:02.624901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:18:07.721373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633699+0000","last_change":"2023-03-06T14:15:58.614740+0000","last_active":"2023-03-06T14:16:02.633699+0000","last_peered":"2023-03-06T14:16:02.633699+0000","last_clean":"2023-03-06T14:16:02.633699+0000","last_became_active":"2023-03-06T14:15:58.614438+0000","last_became_peered":"2023-03-06T14:15:58.614438+0000","last_unstale":"2023-03-06T14:16:02.633699+0000","last_undegraded":"2023-03-06T14:16:02.633699+0000","last_fullsized":"2023-03-06T14:16:02.633699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:01:52.021250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633994+0000","last_change":"2023-03-06T14:15:58.616660+0000","last_active":"2023-03-06T14:16:02.633994+0000","last_peered":"2023-03-06T14:16:02.633994+0000","last_clean":"2023-03-06T14:16:02.633994+0000","last_became_active":"2023-03-06T14:15:58.616421+0000","last_became_peered":"2023-03-06T14:15:58.616421+0000","last_unstale":"2023-03-06T14:16:02.633994+0000","last_undegraded":"2023-03-06T14:16:02.633994+0000","last_fullsized":"2023-03-06T14:16:02.633994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:36.384280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620650+0000","last_change":"2023-03-06T14:15:58.621829+0000","last_active":"2023-03-06T14:16:02.620650+0000","last_peered":"2023-03-06T14:16:02.620650+0000","last_clean":"2023-03-06T14:16:02.620650+0000","last_became_active":"2023-03-06T14:15:58.621536+0000","last_became_peered":"2023-03-06T14:15:58.621536+0000","last_unstale":"2023-03-06T14:16:02.620650+0000","last_undegraded":"2023-03-06T14:16:02.620650+0000","last_fullsized":"2023-03-06T14:16:02.620650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:07:29.050347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633730+0000","last_change":"2023-03-06T14:15:58.628671+0000","last_active":"2023-03-06T14:16:02.633730+0000","last_peered":"2023-03-06T14:16:02.633730+0000","last_clean":"2023-03-06T14:16:02.633730+0000","last_became_active":"2023-03-06T14:15:58.625890+0000","last_became_peered":"2023-03-06T14:15:58.625890+0000","last_unstale":"2023-03-06T14:16:02.633730+0000","last_undegraded":"2023-03-06T14:16:02.633730+0000","last_fullsized":"2023-03-06T14:16:02.633730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:52:46.916668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621598+0000","last_change":"2023-03-06T14:15:58.619050+0000","last_active":"2023-03-06T14:16:02.621598+0000","last_peered":"2023-03-06T14:16:02.621598+0000","last_clean":"2023-03-06T14:16:02.621598+0000","last_became_active":"2023-03-06T14:15:58.618773+0000","last_became_peered":"2023-03-06T14:15:58.618773+0000","last_unstale":"2023-03-06T14:16:02.621598+0000","last_undegraded":"2023-03-06T14:16:02.621598+0000","last_fullsized":"2023-03-06T14:16:02.621598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:02.198113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633760+0000","last_change":"2023-03-06T14:15:58.618365+0000","last_active":"2023-03-06T14:16:02.633760+0000","last_peered":"2023-03-06T14:16:02.633760+0000","last_clean":"2023-03-06T14:16:02.633760+0000","last_became_active":"2023-03-06T14:15:58.618051+0000","last_became_peered":"2023-03-06T14:15:58.618051+0000","last_unstale":"2023-03-06T14:16:02.633760+0000","last_undegraded":"2023-03-06T14:16:02.633760+0000","last_fullsized":"2023-03-06T14:16:02.633760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.625083+0000","last_change":"2023-03-06T14:15:58.619631+0000","last_active":"2023-03-06T14:16:02.625083+0000","last_peered":"2023-03-06T14:16:02.625083+0000","last_clean":"2023-03-06T14:16:02.625083+0000","last_became_active":"2023-03-06T14:15:58.619269+0000","last_became_peered":"2023-03-06T14:15:58.619269+0000","last_unstale":"2023-03-06T14:16:02.625083+0000","last_undegraded":"2023-03-06T14:16:02.625083+0000","last_fullsized":"2023-03-06T14:16:02.625083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:37:25.467445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633840+0000","last_change":"2023-03-06T14:15:58.626814+0000","last_active":"2023-03-06T14:16:02.633840+0000","last_peered":"2023-03-06T14:16:02.633840+0000","last_clean":"2023-03-06T14:16:02.633840+0000","last_became_active":"2023-03-06T14:15:58.626375+0000","last_became_peered":"2023-03-06T14:15:58.626375+0000","last_unstale":"2023-03-06T14:16:02.633840+0000","last_undegraded":"2023-03-06T14:16:02.633840+0000","last_fullsized":"2023-03-06T14:16:02.633840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:52.649365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.624599+0000","last_change":"2023-03-06T14:15:58.612672+0000","last_active":"2023-03-06T14:16:02.624599+0000","last_peered":"2023-03-06T14:16:02.624599+0000","last_clean":"2023-03-06T14:16:02.624599+0000","last_became_active":"2023-03-06T14:15:58.612397+0000","last_became_peered":"2023-03-06T14:15:58.612397+0000","last_unstale":"2023-03-06T14:16:02.624599+0000","last_undegraded":"2023-03-06T14:16:02.624599+0000","last_fullsized":"2023-03-06T14:16:02.624599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:11:35.054920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631524+0000","last_change":"2023-03-06T14:15:58.633204+0000","last_active":"2023-03-06T14:16:02.631524+0000","last_peered":"2023-03-06T14:16:02.631524+0000","last_clean":"2023-03-06T14:16:02.631524+0000","last_became_active":"2023-03-06T14:15:58.632916+0000","last_became_peered":"2023-03-06T14:15:58.632916+0000","last_unstale":"2023-03-06T14:16:02.631524+0000","last_undegraded":"2023-03-06T14:16:02.631524+0000","last_fullsized":"2023-03-06T14:16:02.631524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.626753+0000","last_change":"2023-03-06T14:15:58.626811+0000","last_active":"2023-03-06T14:16:02.626753+0000","last_peered":"2023-03-06T14:16:02.626753+0000","last_clean":"2023-03-06T14:16:02.626753+0000","last_became_active":"2023-03-06T14:15:58.626343+0000","last_became_peered":"2023-03-06T14:15:58.626343+0000","last_unstale":"2023-03-06T14:16:02.626753+0000","last_undegraded":"2023-03-06T14:16:02.626753+0000","last_fullsized":"2023-03-06T14:16:02.626753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:38:05.275651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620103+0000","last_change":"2023-03-06T14:15:58.619060+0000","last_active":"2023-03-06T14:16:02.620103+0000","last_peered":"2023-03-06T14:16:02.620103+0000","last_clean":"2023-03-06T14:16:02.620103+0000","last_became_active":"2023-03-06T14:15:58.618364+0000","last_became_peered":"2023-03-06T14:15:58.618364+0000","last_unstale":"2023-03-06T14:16:02.620103+0000","last_undegraded":"2023-03-06T14:16:02.620103+0000","last_fullsized":"2023-03-06T14:16:02.620103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:10:40.167591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631039+0000","last_change":"2023-03-06T14:15:58.633217+0000","last_active":"2023-03-06T14:16:02.631039+0000","last_peered":"2023-03-06T14:16:02.631039+0000","last_clean":"2023-03-06T14:16:02.631039+0000","last_became_active":"2023-03-06T14:15:58.632914+0000","last_became_peered":"2023-03-06T14:15:58.632914+0000","last_unstale":"2023-03-06T14:16:02.631039+0000","last_undegraded":"2023-03-06T14:16:02.631039+0000","last_fullsized":"2023-03-06T14:16:02.631039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637804+0000","last_change":"2023-03-06T14:15:58.623997+0000","last_active":"2023-03-06T14:16:02.637804+0000","last_peered":"2023-03-06T14:16:02.637804+0000","last_clean":"2023-03-06T14:16:02.637804+0000","last_became_active":"2023-03-06T14:15:58.623647+0000","last_became_peered":"2023-03-06T14:15:58.623647+0000","last_unstale":"2023-03-06T14:16:02.637804+0000","last_undegraded":"2023-03-06T14:16:02.637804+0000","last_fullsized":"2023-03-06T14:16:02.637804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:07:29.050347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637576+0000","last_change":"2023-03-06T14:15:58.627972+0000","last_active":"2023-03-06T14:16:02.637576+0000","last_peered":"2023-03-06T14:16:02.637576+0000","last_clean":"2023-03-06T14:16:02.637576+0000","last_became_active":"2023-03-06T14:15:58.624590+0000","last_became_peered":"2023-03-06T14:15:58.624590+0000","last_unstale":"2023-03-06T14:16:02.637576+0000","last_undegraded":"2023-03-06T14:16:02.637576+0000","last_fullsized":"2023-03-06T14:16:02.637576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623548+0000","last_change":"2023-03-06T14:15:58.630237+0000","last_active":"2023-03-06T14:16:02.623548+0000","last_peered":"2023-03-06T14:16:02.623548+0000","last_clean":"2023-03-06T14:16:02.623548+0000","last_became_active":"2023-03-06T14:15:58.629950+0000","last_became_peered":"2023-03-06T14:15:58.629950+0000","last_unstale":"2023-03-06T14:16:02.623548+0000","last_undegraded":"2023-03-06T14:16:02.623548+0000","last_fullsized":"2023-03-06T14:16:02.623548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.355023+0000","last_change":"2023-03-06T14:16:02.646596+0000","last_active":"2023-03-06T14:16:03.355023+0000","last_peered":"2023-03-06T14:16:03.355023+0000","last_clean":"2023-03-06T14:16:03.355023+0000","last_became_active":"2023-03-06T14:16:02.646087+0000","last_became_peered":"2023-03-06T14:16:02.646087+0000","last_unstale":"2023-03-06T14:16:03.355023+0000","last_undegraded":"2023-03-06T14:16:03.355023+0000","last_fullsized":"2023-03-06T14:16:03.355023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:06:47.997273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623579+0000","last_change":"2023-03-06T14:15:58.199019+0000","last_active":"2023-03-06T14:16:02.623579+0000","last_peered":"2023-03-06T14:16:02.623579+0000","last_clean":"2023-03-06T14:16:02.623579+0000","last_became_active":"2023-03-06T14:15:58.198549+0000","last_became_peered":"2023-03-06T14:15:58.198549+0000","last_unstale":"2023-03-06T14:16:02.623579+0000","last_undegraded":"2023-03-06T14:16:02.623579+0000","last_fullsized":"2023-03-06T14:16:02.623579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:38:41.806931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620438+0000","last_change":"2023-03-06T14:15:58.624265+0000","last_active":"2023-03-06T14:16:02.620438+0000","last_peered":"2023-03-06T14:16:02.620438+0000","last_clean":"2023-03-06T14:16:02.620438+0000","last_became_active":"2023-03-06T14:15:58.624013+0000","last_became_peered":"2023-03-06T14:15:58.624013+0000","last_unstale":"2023-03-06T14:16:02.620438+0000","last_undegraded":"2023-03-06T14:16:02.620438+0000","last_fullsized":"2023-03-06T14:16:02.620438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:38.013992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046786+0000","last_change":"2023-03-06T14:16:02.636774+0000","last_active":"2023-03-06T14:16:03.046786+0000","last_peered":"2023-03-06T14:16:03.046786+0000","last_clean":"2023-03-06T14:16:03.046786+0000","last_became_active":"2023-03-06T14:16:02.636419+0000","last_became_peered":"2023-03-06T14:16:02.636419+0000","last_unstale":"2023-03-06T14:16:03.046786+0000","last_undegraded":"2023-03-06T14:16:03.046786+0000","last_fullsized":"2023-03-06T14:16:03.046786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:11:50.112514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.636039+0000","last_change":"2023-03-06T14:15:58.193447+0000","last_active":"2023-03-06T14:16:02.636039+0000","last_peered":"2023-03-06T14:16:02.636039+0000","last_clean":"2023-03-06T14:16:02.636039+0000","last_became_active":"2023-03-06T14:15:58.193156+0000","last_became_peered":"2023-03-06T14:15:58.193156+0000","last_unstale":"2023-03-06T14:16:02.636039+0000","last_undegraded":"2023-03-06T14:16:02.636039+0000","last_fullsized":"2023-03-06T14:16:02.636039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:01:51.926759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631312+0000","last_change":"2023-03-06T14:15:58.631829+0000","last_active":"2023-03-06T14:16:02.631312+0000","last_peered":"2023-03-06T14:16:02.631312+0000","last_clean":"2023-03-06T14:16:02.631312+0000","last_became_active":"2023-03-06T14:15:58.631539+0000","last_became_peered":"2023-03-06T14:15:58.631539+0000","last_unstale":"2023-03-06T14:16:02.631312+0000","last_undegraded":"2023-03-06T14:16:02.631312+0000","last_fullsized":"2023-03-06T14:16:02.631312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:07:29.050347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.152775+0000","last_change":"2023-03-06T14:16:02.651029+0000","last_active":"2023-03-06T14:16:03.152775+0000","last_peered":"2023-03-06T14:16:03.152775+0000","last_clean":"2023-03-06T14:16:03.152775+0000","last_became_active":"2023-03-06T14:16:02.647451+0000","last_became_peered":"2023-03-06T14:16:02.647451+0000","last_unstale":"2023-03-06T14:16:03.152775+0000","last_undegraded":"2023-03-06T14:16:03.152775+0000","last_fullsized":"2023-03-06T14:16:03.152775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:42:32.218248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620790+0000","last_change":"2023-03-06T14:15:58.199612+0000","last_active":"2023-03-06T14:16:02.620790+0000","last_peered":"2023-03-06T14:16:02.620790+0000","last_clean":"2023-03-06T14:16:02.620790+0000","last_became_active":"2023-03-06T14:15:58.199287+0000","last_became_peered":"2023-03-06T14:15:58.199287+0000","last_unstale":"2023-03-06T14:16:02.620790+0000","last_undegraded":"2023-03-06T14:16:02.620790+0000","last_fullsized":"2023-03-06T14:16:02.620790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:01:51.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628754+0000","last_change":"2023-03-06T14:15:58.623084+0000","last_active":"2023-03-06T14:16:02.628754+0000","last_peered":"2023-03-06T14:16:02.628754+0000","last_clean":"2023-03-06T14:16:02.628754+0000","last_became_active":"2023-03-06T14:15:58.622619+0000","last_became_peered":"2023-03-06T14:15:58.622619+0000","last_unstale":"2023-03-06T14:16:02.628754+0000","last_undegraded":"2023-03-06T14:16:02.628754+0000","last_fullsized":"2023-03-06T14:16:02.628754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:55:43.155483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046240+0000","last_change":"2023-03-06T14:16:02.649807+0000","last_active":"2023-03-06T14:16:03.046240+0000","last_peered":"2023-03-06T14:16:03.046240+0000","last_clean":"2023-03-06T14:16:03.046240+0000","last_became_active":"2023-03-06T14:16:02.649413+0000","last_became_peered":"2023-03-06T14:16:02.649413+0000","last_unstale":"2023-03-06T14:16:03.046240+0000","last_undegraded":"2023-03-06T14:16:03.046240+0000","last_fullsized":"2023-03-06T14:16:03.046240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:21:53.710722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633850+0000","last_change":"2023-03-06T14:15:58.198905+0000","last_active":"2023-03-06T14:16:02.633850+0000","last_peered":"2023-03-06T14:16:02.633850+0000","last_clean":"2023-03-06T14:16:02.633850+0000","last_became_active":"2023-03-06T14:15:58.198283+0000","last_became_peered":"2023-03-06T14:15:58.198283+0000","last_unstale":"2023-03-06T14:16:02.633850+0000","last_undegraded":"2023-03-06T14:16:02.633850+0000","last_fullsized":"2023-03-06T14:16:02.633850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:51.640135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620677+0000","last_change":"2023-03-06T14:15:58.629610+0000","last_active":"2023-03-06T14:16:02.620677+0000","last_peered":"2023-03-06T14:16:02.620677+0000","last_clean":"2023-03-06T14:16:02.620677+0000","last_became_active":"2023-03-06T14:15:58.629363+0000","last_became_peered":"2023-03-06T14:15:58.629363+0000","last_unstale":"2023-03-06T14:16:02.620677+0000","last_undegraded":"2023-03-06T14:16:02.620677+0000","last_fullsized":"2023-03-06T14:16:02.620677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.354086+0000","last_change":"2023-03-06T14:16:02.648003+0000","last_active":"2023-03-06T14:16:03.354086+0000","last_peered":"2023-03-06T14:16:03.354086+0000","last_clean":"2023-03-06T14:16:03.354086+0000","last_became_active":"2023-03-06T14:16:02.647584+0000","last_became_peered":"2023-03-06T14:16:02.647584+0000","last_unstale":"2023-03-06T14:16:03.354086+0000","last_undegraded":"2023-03-06T14:16:03.354086+0000","last_fullsized":"2023-03-06T14:16:03.354086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:07:43.686453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622697+0000","last_change":"2023-03-06T14:15:58.196508+0000","last_active":"2023-03-06T14:16:02.622697+0000","last_peered":"2023-03-06T14:16:02.622697+0000","last_clean":"2023-03-06T14:16:02.622697+0000","last_became_active":"2023-03-06T14:15:58.196196+0000","last_became_peered":"2023-03-06T14:15:58.196196+0000","last_unstale":"2023-03-06T14:16:02.622697+0000","last_undegraded":"2023-03-06T14:16:02.622697+0000","last_fullsized":"2023-03-06T14:16:02.622697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:35.375050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620110+0000","last_change":"2023-03-06T14:15:58.630871+0000","last_active":"2023-03-06T14:16:02.620110+0000","last_peered":"2023-03-06T14:16:02.620110+0000","last_clean":"2023-03-06T14:16:02.620110+0000","last_became_active":"2023-03-06T14:15:58.630600+0000","last_became_peered":"2023-03-06T14:15:58.630600+0000","last_unstale":"2023-03-06T14:16:02.620110+0000","last_undegraded":"2023-03-06T14:16:02.620110+0000","last_fullsized":"2023-03-06T14:16:02.620110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:11:46.673965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046607+0000","last_change":"2023-03-06T14:16:02.647406+0000","last_active":"2023-03-06T14:16:03.046607+0000","last_peered":"2023-03-06T14:16:03.046607+0000","last_clean":"2023-03-06T14:16:03.046607+0000","last_became_active":"2023-03-06T14:16:02.646991+0000","last_became_peered":"2023-03-06T14:16:02.646991+0000","last_unstale":"2023-03-06T14:16:03.046607+0000","last_undegraded":"2023-03-06T14:16:03.046607+0000","last_fullsized":"2023-03-06T14:16:03.046607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:08:18.196610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631874+0000","last_change":"2023-03-06T14:15:58.203832+0000","last_active":"2023-03-06T14:16:02.631874+0000","last_peered":"2023-03-06T14:16:02.631874+0000","last_clean":"2023-03-06T14:16:02.631874+0000","last_became_active":"2023-03-06T14:15:58.202151+0000","last_became_peered":"2023-03-06T14:15:58.202151+0000","last_unstale":"2023-03-06T14:16:02.631874+0000","last_undegraded":"2023-03-06T14:16:02.631874+0000","last_fullsized":"2023-03-06T14:16:02.631874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:48:04.338436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637281+0000","last_change":"2023-03-06T14:15:58.623887+0000","last_active":"2023-03-06T14:16:02.637281+0000","last_peered":"2023-03-06T14:16:02.637281+0000","last_clean":"2023-03-06T14:16:02.637281+0000","last_became_active":"2023-03-06T14:15:58.623588+0000","last_became_peered":"2023-03-06T14:15:58.623588+0000","last_unstale":"2023-03-06T14:16:02.637281+0000","last_undegraded":"2023-03-06T14:16:02.637281+0000","last_fullsized":"2023-03-06T14:16:02.637281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:07:29.725804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.154947+0000","last_change":"2023-03-06T14:16:02.640486+0000","last_active":"2023-03-06T14:16:03.154947+0000","last_peered":"2023-03-06T14:16:03.154947+0000","last_clean":"2023-03-06T14:16:03.154947+0000","last_became_active":"2023-03-06T14:16:02.640118+0000","last_became_peered":"2023-03-06T14:16:02.640118+0000","last_unstale":"2023-03-06T14:16:03.154947+0000","last_undegraded":"2023-03-06T14:16:03.154947+0000","last_fullsized":"2023-03-06T14:16:03.154947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:27:58.703596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:14.065253+0000","last_change":"2023-03-06T14:15:58.192763+0000","last_active":"2023-03-06T14:16:14.065253+0000","last_peered":"2023-03-06T14:16:14.065253+0000","last_clean":"2023-03-06T14:16:14.065253+0000","last_became_active":"2023-03-06T14:15:58.192461+0000","last_became_peered":"2023-03-06T14:15:58.192461+0000","last_unstale":"2023-03-06T14:16:14.065253+0000","last_undegraded":"2023-03-06T14:16:14.065253+0000","last_fullsized":"2023-03-06T14:16:14.065253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:29:15.572837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3746,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623479+0000","last_change":"2023-03-06T14:15:58.617934+0000","last_active":"2023-03-06T14:16:02.623479+0000","last_peered":"2023-03-06T14:16:02.623479+0000","last_clean":"2023-03-06T14:16:02.623479+0000","last_became_active":"2023-03-06T14:15:58.617387+0000","last_became_peered":"2023-03-06T14:15:58.617387+0000","last_unstale":"2023-03-06T14:16:02.623479+0000","last_undegraded":"2023-03-06T14:16:02.623479+0000","last_fullsized":"2023-03-06T14:16:02.623479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:18:06.098146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045480+0000","last_change":"2023-03-06T14:16:02.648850+0000","last_active":"2023-03-06T14:16:03.045480+0000","last_peered":"2023-03-06T14:16:03.045480+0000","last_clean":"2023-03-06T14:16:03.045480+0000","last_became_active":"2023-03-06T14:16:02.648464+0000","last_became_peered":"2023-03-06T14:16:02.648464+0000","last_unstale":"2023-03-06T14:16:03.045480+0000","last_undegraded":"2023-03-06T14:16:03.045480+0000","last_fullsized":"2023-03-06T14:16:03.045480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:36:04.845196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631439+0000","last_change":"2023-03-06T14:15:58.196704+0000","last_active":"2023-03-06T14:16:02.631439+0000","last_peered":"2023-03-06T14:16:02.631439+0000","last_clean":"2023-03-06T14:16:02.631439+0000","last_became_active":"2023-03-06T14:15:58.196420+0000","last_became_peered":"2023-03-06T14:15:58.196420+0000","last_unstale":"2023-03-06T14:16:02.631439+0000","last_undegraded":"2023-03-06T14:16:02.631439+0000","last_fullsized":"2023-03-06T14:16:02.631439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:30:50.230310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620609+0000","last_change":"2023-03-06T14:15:58.624384+0000","last_active":"2023-03-06T14:16:02.620609+0000","last_peered":"2023-03-06T14:16:02.620609+0000","last_clean":"2023-03-06T14:16:02.620609+0000","last_became_active":"2023-03-06T14:15:58.624104+0000","last_became_peered":"2023-03-06T14:15:58.624104+0000","last_unstale":"2023-03-06T14:16:02.620609+0000","last_undegraded":"2023-03-06T14:16:02.620609+0000","last_fullsized":"2023-03-06T14:16:02.620609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046476+0000","last_change":"2023-03-06T14:16:02.649893+0000","last_active":"2023-03-06T14:16:03.046476+0000","last_peered":"2023-03-06T14:16:03.046476+0000","last_clean":"2023-03-06T14:16:03.046476+0000","last_became_active":"2023-03-06T14:16:02.649449+0000","last_became_peered":"2023-03-06T14:16:02.649449+0000","last_unstale":"2023-03-06T14:16:03.046476+0000","last_undegraded":"2023-03-06T14:16:03.046476+0000","last_fullsized":"2023-03-06T14:16:03.046476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:16:47.318848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.626428+0000","last_change":"2023-03-06T14:15:58.199816+0000","last_active":"2023-03-06T14:16:02.626428+0000","last_peered":"2023-03-06T14:16:02.626428+0000","last_clean":"2023-03-06T14:16:02.626428+0000","last_became_active":"2023-03-06T14:15:58.198949+0000","last_became_peered":"2023-03-06T14:15:58.198949+0000","last_unstale":"2023-03-06T14:16:02.626428+0000","last_undegraded":"2023-03-06T14:16:02.626428+0000","last_fullsized":"2023-03-06T14:16:02.626428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:38:41.806931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623461+0000","last_change":"2023-03-06T14:15:58.630195+0000","last_active":"2023-03-06T14:16:02.623461+0000","last_peered":"2023-03-06T14:16:02.623461+0000","last_clean":"2023-03-06T14:16:02.623461+0000","last_became_active":"2023-03-06T14:15:58.629926+0000","last_became_peered":"2023-03-06T14:15:58.629926+0000","last_unstale":"2023-03-06T14:16:02.623461+0000","last_undegraded":"2023-03-06T14:16:02.623461+0000","last_fullsized":"2023-03-06T14:16:02.623461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046473+0000","last_change":"2023-03-06T14:16:02.650159+0000","last_active":"2023-03-06T14:16:03.046473+0000","last_peered":"2023-03-06T14:16:03.046473+0000","last_clean":"2023-03-06T14:16:03.046473+0000","last_became_active":"2023-03-06T14:16:02.649734+0000","last_became_peered":"2023-03-06T14:16:02.649734+0000","last_unstale":"2023-03-06T14:16:03.046473+0000","last_undegraded":"2023-03-06T14:16:03.046473+0000","last_fullsized":"2023-03-06T14:16:03.046473+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:12:39.833476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633836+0000","last_change":"2023-03-06T14:15:58.197641+0000","last_active":"2023-03-06T14:16:02.633836+0000","last_peered":"2023-03-06T14:16:02.633836+0000","last_clean":"2023-03-06T14:16:02.633836+0000","last_became_active":"2023-03-06T14:15:58.197332+0000","last_became_peered":"2023-03-06T14:15:58.197332+0000","last_unstale":"2023-03-06T14:16:02.633836+0000","last_undegraded":"2023-03-06T14:16:02.633836+0000","last_fullsized":"2023-03-06T14:16:02.633836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:42:02.415337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631395+0000","last_change":"2023-03-06T14:15:58.619271+0000","last_active":"2023-03-06T14:16:02.631395+0000","last_peered":"2023-03-06T14:16:02.631395+0000","last_clean":"2023-03-06T14:16:02.631395+0000","last_became_active":"2023-03-06T14:15:58.618980+0000","last_became_peered":"2023-03-06T14:15:58.618980+0000","last_unstale":"2023-03-06T14:16:02.631395+0000","last_undegraded":"2023-03-06T14:16:02.631395+0000","last_fullsized":"2023-03-06T14:16:02.631395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045038+0000","last_change":"2023-03-06T14:16:02.641990+0000","last_active":"2023-03-06T14:16:03.045038+0000","last_peered":"2023-03-06T14:16:03.045038+0000","last_clean":"2023-03-06T14:16:03.045038+0000","last_became_active":"2023-03-06T14:16:02.641619+0000","last_became_peered":"2023-03-06T14:16:02.641619+0000","last_unstale":"2023-03-06T14:16:03.045038+0000","last_undegraded":"2023-03-06T14:16:03.045038+0000","last_fullsized":"2023-03-06T14:16:03.045038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:07:17.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628320+0000","last_change":"2023-03-06T14:15:58.199278+0000","last_active":"2023-03-06T14:16:02.628320+0000","last_peered":"2023-03-06T14:16:02.628320+0000","last_clean":"2023-03-06T14:16:02.628320+0000","last_became_active":"2023-03-06T14:15:58.198946+0000","last_became_peered":"2023-03-06T14:15:58.198946+0000","last_unstale":"2023-03-06T14:16:02.628320+0000","last_undegraded":"2023-03-06T14:16:02.628320+0000","last_fullsized":"2023-03-06T14:16:02.628320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:56:39.417304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621143+0000","last_change":"2023-03-06T14:15:58.630272+0000","last_active":"2023-03-06T14:16:02.621143+0000","last_peered":"2023-03-06T14:16:02.621143+0000","last_clean":"2023-03-06T14:16:02.621143+0000","last_became_active":"2023-03-06T14:15:58.630009+0000","last_became_peered":"2023-03-06T14:15:58.630009+0000","last_unstale":"2023-03-06T14:16:02.621143+0000","last_undegraded":"2023-03-06T14:16:02.621143+0000","last_fullsized":"2023-03-06T14:16:02.621143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:11:35.054920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.355117+0000","last_change":"2023-03-06T14:16:02.640631+0000","last_active":"2023-03-06T14:16:03.355117+0000","last_peered":"2023-03-06T14:16:03.355117+0000","last_clean":"2023-03-06T14:16:03.355117+0000","last_became_active":"2023-03-06T14:16:02.640221+0000","last_became_peered":"2023-03-06T14:16:02.640221+0000","last_unstale":"2023-03-06T14:16:03.355117+0000","last_undegraded":"2023-03-06T14:16:03.355117+0000","last_fullsized":"2023-03-06T14:16:03.355117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:27:58.703596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.632795+0000","last_change":"2023-03-06T14:15:58.198789+0000","last_active":"2023-03-06T14:16:02.632795+0000","last_peered":"2023-03-06T14:16:02.632795+0000","last_clean":"2023-03-06T14:16:02.632795+0000","last_became_active":"2023-03-06T14:15:58.197338+0000","last_became_peered":"2023-03-06T14:15:58.197338+0000","last_unstale":"2023-03-06T14:16:02.632795+0000","last_undegraded":"2023-03-06T14:16:02.632795+0000","last_fullsized":"2023-03-06T14:16:02.632795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:55:42.146253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620931+0000","last_change":"2023-03-06T14:15:58.626518+0000","last_active":"2023-03-06T14:16:02.620931+0000","last_peered":"2023-03-06T14:16:02.620931+0000","last_clean":"2023-03-06T14:16:02.620931+0000","last_became_active":"2023-03-06T14:15:58.626233+0000","last_became_peered":"2023-03-06T14:15:58.626233+0000","last_unstale":"2023-03-06T14:16:02.620931+0000","last_undegraded":"2023-03-06T14:16:02.620931+0000","last_fullsized":"2023-03-06T14:16:02.620931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:52:46.916668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291216+0000","last_change":"2023-03-06T14:16:02.650940+0000","last_active":"2023-03-06T14:16:03.291216+0000","last_peered":"2023-03-06T14:16:03.291216+0000","last_clean":"2023-03-06T14:16:03.291216+0000","last_became_active":"2023-03-06T14:16:02.650036+0000","last_became_peered":"2023-03-06T14:16:02.650036+0000","last_unstale":"2023-03-06T14:16:03.291216+0000","last_undegraded":"2023-03-06T14:16:03.291216+0000","last_fullsized":"2023-03-06T14:16:03.291216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:24:02.015602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631826+0000","last_change":"2023-03-06T14:15:58.197042+0000","last_active":"2023-03-06T14:16:02.631826+0000","last_peered":"2023-03-06T14:16:02.631826+0000","last_clean":"2023-03-06T14:16:02.631826+0000","last_became_active":"2023-03-06T14:15:58.196755+0000","last_became_peered":"2023-03-06T14:15:58.196755+0000","last_unstale":"2023-03-06T14:16:02.631826+0000","last_undegraded":"2023-03-06T14:16:02.631826+0000","last_fullsized":"2023-03-06T14:16:02.631826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:05.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622215+0000","last_change":"2023-03-06T14:15:58.624665+0000","last_active":"2023-03-06T14:16:02.622215+0000","last_peered":"2023-03-06T14:16:02.622215+0000","last_clean":"2023-03-06T14:16:02.622215+0000","last_became_active":"2023-03-06T14:15:58.624294+0000","last_became_peered":"2023-03-06T14:15:58.624294+0000","last_unstale":"2023-03-06T14:16:02.622215+0000","last_undegraded":"2023-03-06T14:16:02.622215+0000","last_fullsized":"2023-03-06T14:16:02.622215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:20:31.540353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291400+0000","last_change":"2023-03-06T14:16:02.652542+0000","last_active":"2023-03-06T14:16:03.291400+0000","last_peered":"2023-03-06T14:16:03.291400+0000","last_clean":"2023-03-06T14:16:03.291400+0000","last_became_active":"2023-03-06T14:16:02.652083+0000","last_became_peered":"2023-03-06T14:16:02.652083+0000","last_unstale":"2023-03-06T14:16:03.291400+0000","last_undegraded":"2023-03-06T14:16:03.291400+0000","last_fullsized":"2023-03-06T14:16:03.291400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:18:11.159923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.632018+0000","last_change":"2023-03-06T14:15:58.198266+0000","last_active":"2023-03-06T14:16:02.632018+0000","last_peered":"2023-03-06T14:16:02.632018+0000","last_clean":"2023-03-06T14:16:02.632018+0000","last_became_active":"2023-03-06T14:15:58.197982+0000","last_became_peered":"2023-03-06T14:15:58.197982+0000","last_unstale":"2023-03-06T14:16:02.632018+0000","last_undegraded":"2023-03-06T14:16:02.632018+0000","last_fullsized":"2023-03-06T14:16:02.632018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:35.375050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.627709+0000","last_change":"2023-03-06T14:15:58.626386+0000","last_active":"2023-03-06T14:16:02.627709+0000","last_peered":"2023-03-06T14:16:02.627709+0000","last_clean":"2023-03-06T14:16:02.627709+0000","last_became_active":"2023-03-06T14:15:58.626081+0000","last_became_peered":"2023-03-06T14:15:58.626081+0000","last_unstale":"2023-03-06T14:16:02.627709+0000","last_undegraded":"2023-03-06T14:16:02.627709+0000","last_fullsized":"2023-03-06T14:16:02.627709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:06.411673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291518+0000","last_change":"2023-03-06T14:16:02.645559+0000","last_active":"2023-03-06T14:16:03.291518+0000","last_peered":"2023-03-06T14:16:03.291518+0000","last_clean":"2023-03-06T14:16:03.291518+0000","last_became_active":"2023-03-06T14:16:02.645162+0000","last_became_peered":"2023-03-06T14:16:02.645162+0000","last_unstale":"2023-03-06T14:16:03.291518+0000","last_undegraded":"2023-03-06T14:16:03.291518+0000","last_fullsized":"2023-03-06T14:16:03.291518+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:41.452541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621160+0000","last_change":"2023-03-06T14:15:58.201356+0000","last_active":"2023-03-06T14:16:02.621160+0000","last_peered":"2023-03-06T14:16:02.621160+0000","last_clean":"2023-03-06T14:16:02.621160+0000","last_became_active":"2023-03-06T14:15:58.201039+0000","last_became_peered":"2023-03-06T14:15:58.201039+0000","last_unstale":"2023-03-06T14:16:02.621160+0000","last_undegraded":"2023-03-06T14:16:02.621160+0000","last_fullsized":"2023-03-06T14:16:02.621160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:30:50.230310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637140+0000","last_change":"2023-03-06T14:15:58.626686+0000","last_active":"2023-03-06T14:16:02.637140+0000","last_peered":"2023-03-06T14:16:02.637140+0000","last_clean":"2023-03-06T14:16:02.637140+0000","last_became_active":"2023-03-06T14:15:58.626389+0000","last_became_peered":"2023-03-06T14:15:58.626389+0000","last_unstale":"2023-03-06T14:16:02.637140+0000","last_undegraded":"2023-03-06T14:16:02.637140+0000","last_fullsized":"2023-03-06T14:16:02.637140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:20:31.540353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291620+0000","last_change":"2023-03-06T14:16:02.642347+0000","last_active":"2023-03-06T14:16:03.291620+0000","last_peered":"2023-03-06T14:16:03.291620+0000","last_clean":"2023-03-06T14:16:03.291620+0000","last_became_active":"2023-03-06T14:16:02.641731+0000","last_became_peered":"2023-03-06T14:16:02.641731+0000","last_unstale":"2023-03-06T14:16:03.291620+0000","last_undegraded":"2023-03-06T14:16:03.291620+0000","last_fullsized":"2023-03-06T14:16:03.291620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:44:38.354278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620347+0000","last_change":"2023-03-06T14:15:58.203350+0000","last_active":"2023-03-06T14:16:02.620347+0000","last_peered":"2023-03-06T14:16:02.620347+0000","last_clean":"2023-03-06T14:16:02.620347+0000","last_became_active":"2023-03-06T14:15:58.203061+0000","last_became_peered":"2023-03-06T14:15:58.203061+0000","last_unstale":"2023-03-06T14:16:02.620347+0000","last_undegraded":"2023-03-06T14:16:02.620347+0000","last_fullsized":"2023-03-06T14:16:02.620347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:51.640135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623485+0000","last_change":"2023-03-06T14:15:58.622192+0000","last_active":"2023-03-06T14:16:02.623485+0000","last_peered":"2023-03-06T14:16:02.623485+0000","last_clean":"2023-03-06T14:16:02.623485+0000","last_became_active":"2023-03-06T14:15:58.621902+0000","last_became_peered":"2023-03-06T14:15:58.621902+0000","last_unstale":"2023-03-06T14:16:02.623485+0000","last_undegraded":"2023-03-06T14:16:02.623485+0000","last_fullsized":"2023-03-06T14:16:02.623485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:44:34.915729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.155015+0000","last_change":"2023-03-06T14:16:02.646555+0000","last_active":"2023-03-06T14:16:03.155015+0000","last_peered":"2023-03-06T14:16:03.155015+0000","last_clean":"2023-03-06T14:16:03.155015+0000","last_became_active":"2023-03-06T14:16:02.646107+0000","last_became_peered":"2023-03-06T14:16:02.646107+0000","last_unstale":"2023-03-06T14:16:03.155015+0000","last_undegraded":"2023-03-06T14:16:03.155015+0000","last_fullsized":"2023-03-06T14:16:03.155015+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:07:43.686453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.627804+0000","last_change":"2023-03-06T14:15:58.190228+0000","last_active":"2023-03-06T14:16:02.627804+0000","last_peered":"2023-03-06T14:16:02.627804+0000","last_clean":"2023-03-06T14:16:02.627804+0000","last_became_active":"2023-03-06T14:15:58.189952+0000","last_became_peered":"2023-03-06T14:15:58.189952+0000","last_unstale":"2023-03-06T14:16:02.627804+0000","last_undegraded":"2023-03-06T14:16:02.627804+0000","last_fullsized":"2023-03-06T14:16:02.627804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:29:15.572837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.624802+0000","last_change":"2023-03-06T14:15:58.618284+0000","last_active":"2023-03-06T14:16:02.624802+0000","last_peered":"2023-03-06T14:16:02.624802+0000","last_clean":"2023-03-06T14:16:02.624802+0000","last_became_active":"2023-03-06T14:15:58.617886+0000","last_became_peered":"2023-03-06T14:15:58.617886+0000","last_unstale":"2023-03-06T14:16:02.624802+0000","last_undegraded":"2023-03-06T14:16:02.624802+0000","last_fullsized":"2023-03-06T14:16:02.624802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:10:40.167591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045610+0000","last_change":"2023-03-06T14:16:02.647040+0000","last_active":"2023-03-06T14:16:03.045610+0000","last_peered":"2023-03-06T14:16:03.045610+0000","last_clean":"2023-03-06T14:16:03.045610+0000","last_became_active":"2023-03-06T14:16:02.645423+0000","last_became_peered":"2023-03-06T14:16:02.645423+0000","last_unstale":"2023-03-06T14:16:03.045610+0000","last_undegraded":"2023-03-06T14:16:03.045610+0000","last_fullsized":"2023-03-06T14:16:03.045610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:13:57.742131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622031+0000","last_change":"2023-03-06T14:15:58.197730+0000","last_active":"2023-03-06T14:16:02.622031+0000","last_peered":"2023-03-06T14:16:02.622031+0000","last_clean":"2023-03-06T14:16:02.622031+0000","last_became_active":"2023-03-06T14:15:58.197400+0000","last_became_peered":"2023-03-06T14:15:58.197400+0000","last_unstale":"2023-03-06T14:16:02.622031+0000","last_undegraded":"2023-03-06T14:16:02.622031+0000","last_fullsized":"2023-03-06T14:16:02.622031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:56:39.417304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.625017+0000","last_change":"2023-03-06T14:15:58.615181+0000","last_active":"2023-03-06T14:16:02.625017+0000","last_peered":"2023-03-06T14:16:02.625017+0000","last_clean":"2023-03-06T14:16:02.625017+0000","last_became_active":"2023-03-06T14:15:58.614850+0000","last_became_peered":"2023-03-06T14:15:58.614850+0000","last_unstale":"2023-03-06T14:16:02.625017+0000","last_undegraded":"2023-03-06T14:16:02.625017+0000","last_fullsized":"2023-03-06T14:16:02.625017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.354671+0000","last_change":"2023-03-06T14:16:02.646047+0000","last_active":"2023-03-06T14:16:03.354671+0000","last_peered":"2023-03-06T14:16:03.354671+0000","last_clean":"2023-03-06T14:16:03.354671+0000","last_became_active":"2023-03-06T14:16:02.645633+0000","last_became_peered":"2023-03-06T14:16:02.645633+0000","last_unstale":"2023-03-06T14:16:03.354671+0000","last_undegraded":"2023-03-06T14:16:03.354671+0000","last_fullsized":"2023-03-06T14:16:03.354671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:50:22.369914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620211+0000","last_change":"2023-03-06T14:15:58.203072+0000","last_active":"2023-03-06T14:16:02.620211+0000","last_peered":"2023-03-06T14:16:02.620211+0000","last_clean":"2023-03-06T14:16:02.620211+0000","last_became_active":"2023-03-06T14:15:58.202762+0000","last_became_peered":"2023-03-06T14:15:58.202762+0000","last_unstale":"2023-03-06T14:16:02.620211+0000","last_undegraded":"2023-03-06T14:16:02.620211+0000","last_fullsized":"2023-03-06T14:16:02.620211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:01:51.926759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637882+0000","last_change":"2023-03-06T14:15:58.624080+0000","last_active":"2023-03-06T14:16:02.637882+0000","last_peered":"2023-03-06T14:16:02.637882+0000","last_clean":"2023-03-06T14:16:02.637882+0000","last_became_active":"2023-03-06T14:15:58.623721+0000","last_became_peered":"2023-03-06T14:15:58.623721+0000","last_unstale":"2023-03-06T14:16:02.637882+0000","last_undegraded":"2023-03-06T14:16:02.637882+0000","last_fullsized":"2023-03-06T14:16:02.637882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:52:46.916668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.152408+0000","last_change":"2023-03-06T14:16:02.653426+0000","last_active":"2023-03-06T14:16:03.152408+0000","last_peered":"2023-03-06T14:16:03.152408+0000","last_clean":"2023-03-06T14:16:03.152408+0000","last_became_active":"2023-03-06T14:16:02.653013+0000","last_became_peered":"2023-03-06T14:16:02.653013+0000","last_unstale":"2023-03-06T14:16:03.152408+0000","last_undegraded":"2023-03-06T14:16:03.152408+0000","last_fullsized":"2023-03-06T14:16:03.152408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:07:43.686453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637353+0000","last_change":"2023-03-06T14:15:53.577710+0000","last_active":"2023-03-06T14:16:02.637353+0000","last_peered":"2023-03-06T14:16:02.637353+0000","last_clean":"2023-03-06T14:16:02.637353+0000","last_became_active":"2023-03-06T14:15:53.577390+0000","last_became_peered":"2023-03-06T14:15:53.577390+0000","last_unstale":"2023-03-06T14:16:02.637353+0000","last_undegraded":"2023-03-06T14:16:02.637353+0000","last_fullsized":"2023-03-06T14:16:02.637353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:59:36.846415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623367+0000","last_change":"2023-03-06T14:15:58.201310+0000","last_active":"2023-03-06T14:16:02.623367+0000","last_peered":"2023-03-06T14:16:02.623367+0000","last_clean":"2023-03-06T14:16:02.623367+0000","last_became_active":"2023-03-06T14:15:58.200984+0000","last_became_peered":"2023-03-06T14:15:58.200984+0000","last_unstale":"2023-03-06T14:16:02.623367+0000","last_undegraded":"2023-03-06T14:16:02.623367+0000","last_fullsized":"2023-03-06T14:16:02.623367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:01:51.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637200+0000","last_change":"2023-03-06T14:15:58.624165+0000","last_active":"2023-03-06T14:16:02.637200+0000","last_peered":"2023-03-06T14:16:02.637200+0000","last_clean":"2023-03-06T14:16:02.637200+0000","last_became_active":"2023-03-06T14:15:58.623385+0000","last_became_peered":"2023-03-06T14:15:58.623385+0000","last_unstale":"2023-03-06T14:16:02.637200+0000","last_undegraded":"2023-03-06T14:16:02.637200+0000","last_fullsized":"2023-03-06T14:16:02.637200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:48:05.347666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.152390+0000","last_change":"2023-03-06T14:16:02.648398+0000","last_active":"2023-03-06T14:16:03.152390+0000","last_peered":"2023-03-06T14:16:03.152390+0000","last_clean":"2023-03-06T14:16:03.152390+0000","last_became_active":"2023-03-06T14:16:02.647065+0000","last_became_peered":"2023-03-06T14:16:02.647065+0000","last_unstale":"2023-03-06T14:16:03.152390+0000","last_undegraded":"2023-03-06T14:16:03.152390+0000","last_fullsized":"2023-03-06T14:16:03.152390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:07:17.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620733+0000","last_change":"2023-03-06T14:15:53.036374+0000","last_active":"2023-03-06T14:16:02.620733+0000","last_peered":"2023-03-06T14:16:02.620733+0000","last_clean":"2023-03-06T14:16:02.620733+0000","last_became_active":"2023-03-06T14:15:53.036038+0000","last_became_peered":"2023-03-06T14:15:53.036038+0000","last_unstale":"2023-03-06T14:16:02.620733+0000","last_undegraded":"2023-03-06T14:16:02.620733+0000","last_fullsized":"2023-03-06T14:16:02.620733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:59:36.846415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623310+0000","last_change":"2023-03-06T14:15:58.205953+0000","last_active":"2023-03-06T14:16:02.623310+0000","last_peered":"2023-03-06T14:16:02.623310+0000","last_clean":"2023-03-06T14:16:02.623310+0000","last_became_active":"2023-03-06T14:15:58.205660+0000","last_became_peered":"2023-03-06T14:15:58.205660+0000","last_unstale":"2023-03-06T14:16:02.623310+0000","last_undegraded":"2023-03-06T14:16:02.623310+0000","last_fullsized":"2023-03-06T14:16:02.623310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:01:51.926759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637265+0000","last_change":"2023-03-06T14:15:58.623348+0000","last_active":"2023-03-06T14:16:02.637265+0000","last_peered":"2023-03-06T14:16:02.637265+0000","last_clean":"2023-03-06T14:16:02.637265+0000","last_became_active":"2023-03-06T14:15:58.622915+0000","last_became_peered":"2023-03-06T14:15:58.622915+0000","last_unstale":"2023-03-06T14:16:02.637265+0000","last_undegraded":"2023-03-06T14:16:02.637265+0000","last_fullsized":"2023-03-06T14:16:02.637265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291678+0000","last_change":"2023-03-06T14:16:02.651042+0000","last_active":"2023-03-06T14:16:03.291678+0000","last_peered":"2023-03-06T14:16:03.291678+0000","last_clean":"2023-03-06T14:16:03.291678+0000","last_became_active":"2023-03-06T14:16:02.650162+0000","last_became_peered":"2023-03-06T14:16:02.650162+0000","last_unstale":"2023-03-06T14:16:03.291678+0000","last_undegraded":"2023-03-06T14:16:03.291678+0000","last_fullsized":"2023-03-06T14:16:03.291678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:37:28.905994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.634164+0000","last_change":"2023-03-06T14:15:53.036522+0000","last_active":"2023-03-06T14:16:02.634164+0000","last_peered":"2023-03-06T14:16:02.634164+0000","last_clean":"2023-03-06T14:16:02.634164+0000","last_became_active":"2023-03-06T14:15:53.036163+0000","last_became_peered":"2023-03-06T14:15:53.036163+0000","last_unstale":"2023-03-06T14:16:02.634164+0000","last_undegraded":"2023-03-06T14:16:02.634164+0000","last_fullsized":"2023-03-06T14:16:02.634164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:27:14.056008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.635952+0000","last_change":"2023-03-06T14:15:58.197803+0000","last_active":"2023-03-06T14:16:02.635952+0000","last_peered":"2023-03-06T14:16:02.635952+0000","last_clean":"2023-03-06T14:16:02.635952+0000","last_became_active":"2023-03-06T14:15:58.197545+0000","last_became_peered":"2023-03-06T14:15:58.197545+0000","last_unstale":"2023-03-06T14:16:02.635952+0000","last_undegraded":"2023-03-06T14:16:02.635952+0000","last_fullsized":"2023-03-06T14:16:02.635952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:12:34.886024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637845+0000","last_change":"2023-03-06T14:15:58.623911+0000","last_active":"2023-03-06T14:16:02.637845+0000","last_peered":"2023-03-06T14:16:02.637845+0000","last_clean":"2023-03-06T14:16:02.637845+0000","last_became_active":"2023-03-06T14:15:58.623425+0000","last_became_peered":"2023-03-06T14:15:58.623425+0000","last_unstale":"2023-03-06T14:16:02.637845+0000","last_undegraded":"2023-03-06T14:16:02.637845+0000","last_fullsized":"2023-03-06T14:16:02.637845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:25:29.813558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.355462+0000","last_change":"2023-03-06T14:16:02.651414+0000","last_active":"2023-03-06T14:16:03.355462+0000","last_peered":"2023-03-06T14:16:03.355462+0000","last_clean":"2023-03-06T14:16:03.355462+0000","last_became_active":"2023-03-06T14:16:02.650987+0000","last_became_peered":"2023-03-06T14:16:02.650987+0000","last_unstale":"2023-03-06T14:16:03.355462+0000","last_undegraded":"2023-03-06T14:16:03.355462+0000","last_fullsized":"2023-03-06T14:16:03.355462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:07:17.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621937+0000","last_change":"2023-03-06T14:15:53.036219+0000","last_active":"2023-03-06T14:16:02.621937+0000","last_peered":"2023-03-06T14:16:02.621937+0000","last_clean":"2023-03-06T14:16:02.621937+0000","last_became_active":"2023-03-06T14:15:53.035884+0000","last_became_peered":"2023-03-06T14:15:53.035884+0000","last_unstale":"2023-03-06T14:16:02.621937+0000","last_undegraded":"2023-03-06T14:16:02.621937+0000","last_fullsized":"2023-03-06T14:16:02.621937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:08:35.979345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":171,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.630995+0000","last_change":"2023-03-06T14:15:46.468596+0000","last_active":"2023-03-06T14:16:02.630995+0000","last_peered":"2023-03-06T14:16:02.630995+0000","last_clean":"2023-03-06T14:16:02.630995+0000","last_became_active":"2023-03-06T14:15:46.467792+0000","last_became_peered":"2023-03-06T14:15:46.467792+0000","last_unstale":"2023-03-06T14:16:02.630995+0000","last_undegraded":"2023-03-06T14:16:02.630995+0000","last_fullsized":"2023-03-06T14:16:02.630995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:45.376343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:45.376343+0000","last_clean_scrub_stamp":"2023-03-06T14:15:45.376343+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:52:08.690494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620179+0000","last_change":"2023-03-06T14:15:58.193624+0000","last_active":"2023-03-06T14:16:02.620179+0000","last_peered":"2023-03-06T14:16:02.620179+0000","last_clean":"2023-03-06T14:16:02.620179+0000","last_became_active":"2023-03-06T14:15:58.192670+0000","last_became_peered":"2023-03-06T14:15:58.192670+0000","last_unstale":"2023-03-06T14:16:02.620179+0000","last_undegraded":"2023-03-06T14:16:02.620179+0000","last_fullsized":"2023-03-06T14:16:02.620179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:56:39.417304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628029+0000","last_change":"2023-03-06T14:15:58.621410+0000","last_active":"2023-03-06T14:16:02.628029+0000","last_peered":"2023-03-06T14:16:02.628029+0000","last_clean":"2023-03-06T14:16:02.628029+0000","last_became_active":"2023-03-06T14:15:58.621119+0000","last_became_peered":"2023-03-06T14:15:58.621119+0000","last_unstale":"2023-03-06T14:16:02.628029+0000","last_undegraded":"2023-03-06T14:16:02.628029+0000","last_fullsized":"2023-03-06T14:16:02.628029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:07:29.725804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045514+0000","last_change":"2023-03-06T14:16:02.647842+0000","last_active":"2023-03-06T14:16:03.045514+0000","last_peered":"2023-03-06T14:16:03.045514+0000","last_clean":"2023-03-06T14:16:03.045514+0000","last_became_active":"2023-03-06T14:16:02.647453+0000","last_became_peered":"2023-03-06T14:16:02.647453+0000","last_unstale":"2023-03-06T14:16:03.045514+0000","last_undegraded":"2023-03-06T14:16:03.045514+0000","last_fullsized":"2023-03-06T14:16:03.045514+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:16:47.318848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631088+0000","last_change":"2023-03-06T14:15:53.037318+0000","last_active":"2023-03-06T14:16:02.631088+0000","last_peered":"2023-03-06T14:16:02.631088+0000","last_clean":"2023-03-06T14:16:02.631088+0000","last_became_active":"2023-03-06T14:15:53.036984+0000","last_became_peered":"2023-03-06T14:15:53.036984+0000","last_unstale":"2023-03-06T14:16:02.631088+0000","last_undegraded":"2023-03-06T14:16:02.631088+0000","last_fullsized":"2023-03-06T14:16:02.631088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:59:36.846415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633034+0000","last_change":"2023-03-06T14:15:58.203061+0000","last_active":"2023-03-06T14:16:02.633034+0000","last_peered":"2023-03-06T14:16:02.633034+0000","last_clean":"2023-03-06T14:16:02.633034+0000","last_became_active":"2023-03-06T14:15:58.202734+0000","last_became_peered":"2023-03-06T14:15:58.202734+0000","last_unstale":"2023-03-06T14:16:02.633034+0000","last_undegraded":"2023-03-06T14:16:02.633034+0000","last_fullsized":"2023-03-06T14:16:02.633034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:56:39.417304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631131+0000","last_change":"2023-03-06T14:15:58.628462+0000","last_active":"2023-03-06T14:16:02.631131+0000","last_peered":"2023-03-06T14:16:02.631131+0000","last_clean":"2023-03-06T14:16:02.631131+0000","last_became_active":"2023-03-06T14:15:58.628169+0000","last_became_peered":"2023-03-06T14:15:58.628169+0000","last_unstale":"2023-03-06T14:16:02.631131+0000","last_undegraded":"2023-03-06T14:16:02.631131+0000","last_fullsized":"2023-03-06T14:16:02.631131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:11:35.054920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046549+0000","last_change":"2023-03-06T14:16:02.651316+0000","last_active":"2023-03-06T14:16:03.046549+0000","last_peered":"2023-03-06T14:16:03.046549+0000","last_clean":"2023-03-06T14:16:03.046549+0000","last_became_active":"2023-03-06T14:16:02.650952+0000","last_became_peered":"2023-03-06T14:16:02.650952+0000","last_unstale":"2023-03-06T14:16:03.046549+0000","last_undegraded":"2023-03-06T14:16:03.046549+0000","last_fullsized":"2023-03-06T14:16:03.046549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:10:43.606141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631980+0000","last_change":"2023-03-06T14:15:53.577586+0000","last_active":"2023-03-06T14:16:02.631980+0000","last_peered":"2023-03-06T14:16:02.631980+0000","last_clean":"2023-03-06T14:16:02.631980+0000","last_became_active":"2023-03-06T14:15:53.577345+0000","last_became_peered":"2023-03-06T14:15:53.577345+0000","last_unstale":"2023-03-06T14:16:02.631980+0000","last_undegraded":"2023-03-06T14:16:02.631980+0000","last_fullsized":"2023-03-06T14:16:02.631980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:08:35.979345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637442+0000","last_change":"2023-03-06T14:15:58.199583+0000","last_active":"2023-03-06T14:16:02.637442+0000","last_peered":"2023-03-06T14:16:02.637442+0000","last_clean":"2023-03-06T14:16:02.637442+0000","last_became_active":"2023-03-06T14:15:58.199288+0000","last_became_peered":"2023-03-06T14:15:58.199288+0000","last_unstale":"2023-03-06T14:16:02.637442+0000","last_undegraded":"2023-03-06T14:16:02.637442+0000","last_fullsized":"2023-03-06T14:16:02.637442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:51.640135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.636887+0000","last_change":"2023-03-06T14:15:58.623642+0000","last_active":"2023-03-06T14:16:02.636887+0000","last_peered":"2023-03-06T14:16:02.636887+0000","last_clean":"2023-03-06T14:16:02.636887+0000","last_became_active":"2023-03-06T14:15:58.623387+0000","last_became_peered":"2023-03-06T14:15:58.623387+0000","last_unstale":"2023-03-06T14:16:02.636887+0000","last_undegraded":"2023-03-06T14:16:02.636887+0000","last_fullsized":"2023-03-06T14:16:02.636887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.355184+0000","last_change":"2023-03-06T14:16:02.639772+0000","last_active":"2023-03-06T14:16:03.355184+0000","last_peered":"2023-03-06T14:16:03.355184+0000","last_clean":"2023-03-06T14:16:03.355184+0000","last_became_active":"2023-03-06T14:16:02.639392+0000","last_became_peered":"2023-03-06T14:16:02.639392+0000","last_unstale":"2023-03-06T14:16:03.355184+0000","last_undegraded":"2023-03-06T14:16:03.355184+0000","last_fullsized":"2023-03-06T14:16:03.355184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:24:14.685213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620927+0000","last_change":"2023-03-06T14:15:58.196943+0000","last_active":"2023-03-06T14:16:02.620927+0000","last_peered":"2023-03-06T14:16:02.620927+0000","last_clean":"2023-03-06T14:16:02.620927+0000","last_became_active":"2023-03-06T14:15:58.196688+0000","last_became_peered":"2023-03-06T14:15:58.196688+0000","last_unstale":"2023-03-06T14:16:02.620927+0000","last_undegraded":"2023-03-06T14:16:02.620927+0000","last_fullsized":"2023-03-06T14:16:02.620927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:12:34.886024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637450+0000","last_change":"2023-03-06T14:15:53.040061+0000","last_active":"2023-03-06T14:16:02.637450+0000","last_peered":"2023-03-06T14:16:02.637450+0000","last_clean":"2023-03-06T14:16:02.637450+0000","last_became_active":"2023-03-06T14:15:53.039743+0000","last_became_peered":"2023-03-06T14:15:53.039743+0000","last_unstale":"2023-03-06T14:16:02.637450+0000","last_undegraded":"2023-03-06T14:16:02.637450+0000","last_fullsized":"2023-03-06T14:16:02.637450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:08:35.979345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620100+0000","last_change":"2023-03-06T14:15:58.630844+0000","last_active":"2023-03-06T14:16:02.620100+0000","last_peered":"2023-03-06T14:16:02.620100+0000","last_clean":"2023-03-06T14:16:02.620100+0000","last_became_active":"2023-03-06T14:15:58.630559+0000","last_became_peered":"2023-03-06T14:15:58.630559+0000","last_unstale":"2023-03-06T14:16:02.620100+0000","last_undegraded":"2023-03-06T14:16:02.620100+0000","last_fullsized":"2023-03-06T14:16:02.620100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046029+0000","last_change":"2023-03-06T14:16:02.642401+0000","last_active":"2023-03-06T14:16:03.046029+0000","last_peered":"2023-03-06T14:16:03.046029+0000","last_clean":"2023-03-06T14:16:03.046029+0000","last_became_active":"2023-03-06T14:16:02.641989+0000","last_became_peered":"2023-03-06T14:16:02.641989+0000","last_unstale":"2023-03-06T14:16:03.046029+0000","last_undegraded":"2023-03-06T14:16:03.046029+0000","last_fullsized":"2023-03-06T14:16:03.046029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:36:04.845196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628635+0000","last_change":"2023-03-06T14:15:53.037412+0000","last_active":"2023-03-06T14:16:02.628635+0000","last_peered":"2023-03-06T14:16:02.628635+0000","last_clean":"2023-03-06T14:16:02.628635+0000","last_became_active":"2023-03-06T14:15:53.037136+0000","last_became_peered":"2023-03-06T14:15:53.037136+0000","last_unstale":"2023-03-06T14:16:02.628635+0000","last_undegraded":"2023-03-06T14:16:02.628635+0000","last_fullsized":"2023-03-06T14:16:02.628635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:27:14.056008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.152637+0000","last_change":"2023-03-06T14:15:58.204500+0000","last_active":"2023-03-06T14:16:03.152637+0000","last_peered":"2023-03-06T14:16:03.152637+0000","last_clean":"2023-03-06T14:16:03.152637+0000","last_became_active":"2023-03-06T14:15:58.204199+0000","last_became_peered":"2023-03-06T14:15:58.204199+0000","last_unstale":"2023-03-06T14:16:03.152637+0000","last_undegraded":"2023-03-06T14:16:03.152637+0000","last_fullsized":"2023-03-06T14:16:03.152637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:35.375050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622127+0000","last_change":"2023-03-06T14:15:58.619009+0000","last_active":"2023-03-06T14:16:02.622127+0000","last_peered":"2023-03-06T14:16:02.622127+0000","last_clean":"2023-03-06T14:16:02.622127+0000","last_became_active":"2023-03-06T14:15:58.618684+0000","last_became_peered":"2023-03-06T14:15:58.618684+0000","last_unstale":"2023-03-06T14:16:02.622127+0000","last_undegraded":"2023-03-06T14:16:02.622127+0000","last_fullsized":"2023-03-06T14:16:02.622127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:23:58.577053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.155165+0000","last_change":"2023-03-06T14:16:02.648262+0000","last_active":"2023-03-06T14:16:03.155165+0000","last_peered":"2023-03-06T14:16:03.155165+0000","last_clean":"2023-03-06T14:16:03.155165+0000","last_became_active":"2023-03-06T14:16:02.647613+0000","last_became_peered":"2023-03-06T14:16:02.647613+0000","last_unstale":"2023-03-06T14:16:03.155165+0000","last_undegraded":"2023-03-06T14:16:03.155165+0000","last_fullsized":"2023-03-06T14:16:03.155165+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:14:39.393308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.636987+0000","last_change":"2023-03-06T14:15:58.199468+0000","last_active":"2023-03-06T14:16:02.636987+0000","last_peered":"2023-03-06T14:16:02.636987+0000","last_clean":"2023-03-06T14:16:02.636987+0000","last_became_active":"2023-03-06T14:15:58.199198+0000","last_became_peered":"2023-03-06T14:15:58.199198+0000","last_unstale":"2023-03-06T14:16:02.636987+0000","last_undegraded":"2023-03-06T14:16:02.636987+0000","last_fullsized":"2023-03-06T14:16:02.636987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:12:34.886024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.634082+0000","last_change":"2023-03-06T14:15:58.625329+0000","last_active":"2023-03-06T14:16:02.634082+0000","last_peered":"2023-03-06T14:16:02.634082+0000","last_clean":"2023-03-06T14:16:02.634082+0000","last_became_active":"2023-03-06T14:15:58.624965+0000","last_became_peered":"2023-03-06T14:15:58.624965+0000","last_unstale":"2023-03-06T14:16:02.634082+0000","last_undegraded":"2023-03-06T14:16:02.634082+0000","last_fullsized":"2023-03-06T14:16:02.634082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:42:03.424567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.354710+0000","last_change":"2023-03-06T14:16:02.647113+0000","last_active":"2023-03-06T14:16:03.354710+0000","last_peered":"2023-03-06T14:16:03.354710+0000","last_clean":"2023-03-06T14:16:03.354710+0000","last_became_active":"2023-03-06T14:16:02.646705+0000","last_became_peered":"2023-03-06T14:16:02.646705+0000","last_unstale":"2023-03-06T14:16:03.354710+0000","last_undegraded":"2023-03-06T14:16:03.354710+0000","last_fullsized":"2023-03-06T14:16:03.354710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:05.636662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621259+0000","last_change":"2023-03-06T14:15:58.196567+0000","last_active":"2023-03-06T14:16:02.621259+0000","last_peered":"2023-03-06T14:16:02.621259+0000","last_clean":"2023-03-06T14:16:02.621259+0000","last_became_active":"2023-03-06T14:15:58.196276+0000","last_became_peered":"2023-03-06T14:15:58.196276+0000","last_unstale":"2023-03-06T14:16:02.621259+0000","last_undegraded":"2023-03-06T14:16:02.621259+0000","last_fullsized":"2023-03-06T14:16:02.621259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:12:34.886024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623223+0000","last_change":"2023-03-06T14:15:58.618271+0000","last_active":"2023-03-06T14:16:02.623223+0000","last_peered":"2023-03-06T14:16:02.623223+0000","last_clean":"2023-03-06T14:16:02.623223+0000","last_became_active":"2023-03-06T14:15:58.617970+0000","last_became_peered":"2023-03-06T14:15:58.617970+0000","last_unstale":"2023-03-06T14:16:02.623223+0000","last_undegraded":"2023-03-06T14:16:02.623223+0000","last_fullsized":"2023-03-06T14:16:02.623223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:11:46.673965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045161+0000","last_change":"2023-03-06T14:16:02.652165+0000","last_active":"2023-03-06T14:16:03.045161+0000","last_peered":"2023-03-06T14:16:03.045161+0000","last_clean":"2023-03-06T14:16:03.045161+0000","last_became_active":"2023-03-06T14:16:02.651741+0000","last_became_peered":"2023-03-06T14:16:02.651741+0000","last_unstale":"2023-03-06T14:16:03.045161+0000","last_undegraded":"2023-03-06T14:16:03.045161+0000","last_fullsized":"2023-03-06T14:16:03.045161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:12:39.833476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623717+0000","last_change":"2023-03-06T14:15:58.197225+0000","last_active":"2023-03-06T14:16:02.623717+0000","last_peered":"2023-03-06T14:16:02.623717+0000","last_clean":"2023-03-06T14:16:02.623717+0000","last_became_active":"2023-03-06T14:15:58.196965+0000","last_became_peered":"2023-03-06T14:15:58.196965+0000","last_unstale":"2023-03-06T14:16:02.623717+0000","last_undegraded":"2023-03-06T14:16:02.623717+0000","last_fullsized":"2023-03-06T14:16:02.623717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:51.640135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623522+0000","last_change":"2023-03-06T14:15:58.618773+0000","last_active":"2023-03-06T14:16:02.623522+0000","last_peered":"2023-03-06T14:16:02.623522+0000","last_clean":"2023-03-06T14:16:02.623522+0000","last_became_active":"2023-03-06T14:15:58.618462+0000","last_became_peered":"2023-03-06T14:15:58.618462+0000","last_unstale":"2023-03-06T14:16:02.623522+0000","last_undegraded":"2023-03-06T14:16:02.623522+0000","last_fullsized":"2023-03-06T14:16:02.623522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:21:50.272173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.353835+0000","last_change":"2023-03-06T14:16:02.646882+0000","last_active":"2023-03-06T14:16:03.353835+0000","last_peered":"2023-03-06T14:16:03.353835+0000","last_clean":"2023-03-06T14:16:03.353835+0000","last_became_active":"2023-03-06T14:16:02.645688+0000","last_became_peered":"2023-03-06T14:16:02.645688+0000","last_unstale":"2023-03-06T14:16:03.353835+0000","last_undegraded":"2023-03-06T14:16:03.353835+0000","last_fullsized":"2023-03-06T14:16:03.353835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:28:49.627966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621195+0000","last_change":"2023-03-06T14:15:58.193377+0000","last_active":"2023-03-06T14:16:02.621195+0000","last_peered":"2023-03-06T14:16:02.621195+0000","last_clean":"2023-03-06T14:16:02.621195+0000","last_became_active":"2023-03-06T14:15:58.192974+0000","last_became_peered":"2023-03-06T14:15:58.192974+0000","last_unstale":"2023-03-06T14:16:02.621195+0000","last_undegraded":"2023-03-06T14:16:02.621195+0000","last_fullsized":"2023-03-06T14:16:02.621195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:35.375050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620221+0000","last_change":"2023-03-06T14:15:58.619235+0000","last_active":"2023-03-06T14:16:02.620221+0000","last_peered":"2023-03-06T14:16:02.620221+0000","last_clean":"2023-03-06T14:16:02.620221+0000","last_became_active":"2023-03-06T14:15:58.618729+0000","last_became_peered":"2023-03-06T14:15:58.618729+0000","last_unstale":"2023-03-06T14:16:02.620221+0000","last_undegraded":"2023-03-06T14:16:02.620221+0000","last_fullsized":"2023-03-06T14:16:02.620221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:21:50.272173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.155032+0000","last_change":"2023-03-06T14:16:02.643512+0000","last_active":"2023-03-06T14:16:03.155032+0000","last_peered":"2023-03-06T14:16:03.155032+0000","last_clean":"2023-03-06T14:16:03.155032+0000","last_became_active":"2023-03-06T14:16:02.643055+0000","last_became_peered":"2023-03-06T14:16:02.643055+0000","last_unstale":"2023-03-06T14:16:03.155032+0000","last_undegraded":"2023-03-06T14:16:03.155032+0000","last_fullsized":"2023-03-06T14:16:03.155032+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:07:17.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633951+0000","last_change":"2023-03-06T14:15:58.197748+0000","last_active":"2023-03-06T14:16:02.633951+0000","last_peered":"2023-03-06T14:16:02.633951+0000","last_clean":"2023-03-06T14:16:02.633951+0000","last_became_active":"2023-03-06T14:15:58.197244+0000","last_became_peered":"2023-03-06T14:15:58.197244+0000","last_unstale":"2023-03-06T14:16:02.633951+0000","last_undegraded":"2023-03-06T14:16:02.633951+0000","last_fullsized":"2023-03-06T14:16:02.633951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:01:51.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621581+0000","last_change":"2023-03-06T14:15:58.618371+0000","last_active":"2023-03-06T14:16:02.621581+0000","last_peered":"2023-03-06T14:16:02.621581+0000","last_clean":"2023-03-06T14:16:02.621581+0000","last_became_active":"2023-03-06T14:15:58.617809+0000","last_became_peered":"2023-03-06T14:15:58.617809+0000","last_unstale":"2023-03-06T14:16:02.621581+0000","last_undegraded":"2023-03-06T14:16:02.621581+0000","last_fullsized":"2023-03-06T14:16:02.621581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:38.013992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628414+0000","last_change":"2023-03-06T14:15:58.623731+0000","last_active":"2023-03-06T14:16:02.628414+0000","last_peered":"2023-03-06T14:16:02.628414+0000","last_clean":"2023-03-06T14:16:02.628414+0000","last_became_active":"2023-03-06T14:15:58.622566+0000","last_became_peered":"2023-03-06T14:15:58.622566+0000","last_unstale":"2023-03-06T14:16:02.628414+0000","last_undegraded":"2023-03-06T14:16:02.628414+0000","last_fullsized":"2023-03-06T14:16:02.628414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:42:03.424567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620436+0000","last_change":"2023-03-06T14:15:58.625127+0000","last_active":"2023-03-06T14:16:02.620436+0000","last_peered":"2023-03-06T14:16:02.620436+0000","last_clean":"2023-03-06T14:16:02.620436+0000","last_became_active":"2023-03-06T14:15:58.624835+0000","last_became_peered":"2023-03-06T14:15:58.624835+0000","last_unstale":"2023-03-06T14:16:02.620436+0000","last_undegraded":"2023-03-06T14:16:02.620436+0000","last_fullsized":"2023-03-06T14:16:02.620436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:20:31.540353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623660+0000","last_change":"2023-03-06T14:15:58.619829+0000","last_active":"2023-03-06T14:16:02.623660+0000","last_peered":"2023-03-06T14:16:02.623660+0000","last_clean":"2023-03-06T14:16:02.623660+0000","last_became_active":"2023-03-06T14:15:58.618933+0000","last_became_peered":"2023-03-06T14:15:58.618933+0000","last_unstale":"2023-03-06T14:16:02.623660+0000","last_undegraded":"2023-03-06T14:16:02.623660+0000","last_fullsized":"2023-03-06T14:16:02.623660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:37:30.914574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620448+0000","last_change":"2023-03-06T14:15:58.630339+0000","last_active":"2023-03-06T14:16:02.620448+0000","last_peered":"2023-03-06T14:16:02.620448+0000","last_clean":"2023-03-06T14:16:02.620448+0000","last_became_active":"2023-03-06T14:15:58.630079+0000","last_became_peered":"2023-03-06T14:15:58.630079+0000","last_unstale":"2023-03-06T14:16:02.620448+0000","last_undegraded":"2023-03-06T14:16:02.620448+0000","last_fullsized":"2023-03-06T14:16:02.620448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:37:30.914574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637592+0000","last_change":"2023-03-06T14:15:58.632453+0000","last_active":"2023-03-06T14:16:02.637592+0000","last_peered":"2023-03-06T14:16:02.637592+0000","last_clean":"2023-03-06T14:16:02.637592+0000","last_became_active":"2023-03-06T14:15:58.632051+0000","last_became_peered":"2023-03-06T14:15:58.632051+0000","last_unstale":"2023-03-06T14:16:02.637592+0000","last_undegraded":"2023-03-06T14:16:02.637592+0000","last_fullsized":"2023-03-06T14:16:02.637592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4528,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9284,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362556,"statfs":{"total":96636764160,"available":96627257344,"internally_reserved":0,"allocated":913408,"data_stored":714090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8164,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363676,"statfs":{"total":96636764160,"available":96628404224,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9260,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362580,"statfs":{"total":96636764160,"available":96627281920,"internally_reserved":0,"allocated":888832,"data_stored":710835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8248,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363592,"statfs":{"total":96636764160,"available":96628318208,"internally_reserved":0,"allocated":311296,"data_stored":123703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8172,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363668,"statfs":{"total":96636764160,"available":96628396032,"internally_reserved":0,"allocated":299008,"data_stored":120537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-06T14:16:18.303 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-06T14:16:18.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.452+0000 7f95b6e98700 1 Processor -- start 2023-03-06T14:16:18.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.453+0000 7f95b6e98700 1 -- start start 2023-03-06T14:16:18.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.453+0000 7f95b6e98700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f95b00bdd60 0x7f95b00bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:18.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.453+0000 7f95b6e98700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b014ff80 con 0x7f95b006ea70 2023-03-06T14:16:18.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.453+0000 7f95b6e98700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b00bcb90 con 0x7f95b006ee40 2023-03-06T14:16:18.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.453+0000 7f95b6e98700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b00b9070 con 0x7f95b00bdd60 2023-03-06T14:16:18.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.454+0000 7f95b4c34700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f95b006ea70 0x7f95b01490f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58294/0 (socket says 172.21.15.3:58294) 2023-03-06T14:16:18.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.454+0000 7f95b4c34700 1 -- 172.21.15.3:0/3658128617 learned_addr learned my addr 172.21.15.3:0/3658128617 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:18.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.454+0000 7f95b5435700 1 --2- 172.21.15.3:0/3658128617 >> v2:172.21.15.3:3300/0 conn(0x7f95b00bdd60 0x7f95b00bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:18.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.454+0000 7f95af7fe700 1 -- 172.21.15.3:0/3658128617 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861951772 0 0) 0x7f95b014ff80 con 0x7f95b006ea70 2023-03-06T14:16:18.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.454+0000 7f95af7fe700 1 -- 172.21.15.3:0/3658128617 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95a00035b0 con 0x7f95b006ea70 2023-03-06T14:16:18.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.454+0000 7f95b5435700 1 -- 172.21.15.3:0/3658128617 >> v1:172.21.15.136:6789/0 conn(0x7f95b006ee40 legacy=0x7f95b006c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:18.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.454+0000 7f95b5435700 1 -- 172.21.15.3:0/3658128617 >> v1:172.21.15.3:6789/0 conn(0x7f95b006ea70 legacy=0x7f95b01490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:18.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.454+0000 7f95b5435700 1 -- 172.21.15.3:0/3658128617 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b00bce70 con 0x7f95b00bdd60 2023-03-06T14:16:18.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.454+0000 7f95b5435700 1 --2- 172.21.15.3:0/3658128617 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95b00bdd60 0x7f95b00bd670 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009d90 tx=0x7f95a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20206ed4e2176b2d server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:18.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.454+0000 7f95af7fe700 1 -- 172.21.15.3:0/3658128617 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a800e070 con 0x7f95b00bdd60 2023-03-06T14:16:18.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.454+0000 7f95af7fe700 1 -- 172.21.15.3:0/3658128617 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a800bb20 con 0x7f95b00bdd60 2023-03-06T14:16:18.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.454+0000 7f95af7fe700 1 -- 172.21.15.3:0/3658128617 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a800be90 con 0x7f95b00bdd60 2023-03-06T14:16:18.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.455+0000 7f95b6e98700 1 -- 172.21.15.3:0/3658128617 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95b00bdd60 msgr2=0x7f95b00bd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:18.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.455+0000 7f95b6e98700 1 --2- 172.21.15.3:0/3658128617 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95b00bdd60 0x7f95b00bd670 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009d90 tx=0x7f95a800b330 comp rx=0 tx=0).stop 2023-03-06T14:16:18.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.455+0000 7f95b6e98700 1 -- 172.21.15.3:0/3658128617 shutdown_connections 2023-03-06T14:16:18.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.455+0000 7f95b6e98700 1 --2- 172.21.15.3:0/3658128617 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95b00bdd60 0x7f95b00bd670 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.455+0000 7f95b6e98700 1 -- 172.21.15.3:0/3658128617 >> 172.21.15.3:0/3658128617 conn(0x7f95b00c2150 msgr2=0x7f95b00c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:18.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.455+0000 7f95b6e98700 1 -- 172.21.15.3:0/3658128617 shutdown_connections 2023-03-06T14:16:18.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.455+0000 7f95b6e98700 1 -- 172.21.15.3:0/3658128617 wait complete. 2023-03-06T14:16:18.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.456+0000 7f95b6e98700 1 Processor -- start 2023-03-06T14:16:18.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.456+0000 7f95b6e98700 1 -- start start 2023-03-06T14:16:18.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.457+0000 7f95b6e98700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f95b006ea70 0x7f95b01e7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:18.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.457+0000 7f95b6e98700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95b006ee40 0x7f95b0151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:18.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.457+0000 7f95b6e98700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95b00bdd60 0x7f95b0152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:18.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.457+0000 7f95b6e98700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b01380a0 con 0x7f95b00bdd60 2023-03-06T14:16:18.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.457+0000 7f95b6e98700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b01531c0 con 0x7f95b006ee40 2023-03-06T14:16:18.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.457+0000 7f95b6e98700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b01e8440 con 0x7f95b006ea70 2023-03-06T14:16:18.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.457+0000 7f95b5435700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95b00bdd60 0x7f95b0152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:18.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.457+0000 7f95b5435700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95b00bdd60 0x7f95b0152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56032/0 (socket says 172.21.15.3:56032) 2023-03-06T14:16:18.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.457+0000 7f95b5435700 1 -- 172.21.15.3:0/1421237855 learned_addr learned my addr 172.21.15.3:0/1421237855 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:18.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.457+0000 7f95affff700 1 --2- 172.21.15.3:0/1421237855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95b006ee40 0x7f95b0151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:18.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.457+0000 7f95b4c34700 1 --2- 172.21.15.3:0/1421237855 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f95b006ea70 0x7f95b01e7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:18.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.457+0000 7f95b5435700 1 -- 172.21.15.3:0/1421237855 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f95b006ea70 msgr2=0x7f95b01e7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:18.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.457+0000 7f95b5435700 1 --2- 172.21.15.3:0/1421237855 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f95b006ea70 0x7f95b01e7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.457+0000 7f95b5435700 1 -- 172.21.15.3:0/1421237855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95b006ee40 msgr2=0x7f95b0151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:18.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.457+0000 7f95b5435700 1 --2- 172.21.15.3:0/1421237855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95b006ee40 0x7f95b0151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.457+0000 7f95b5435700 1 -- 172.21.15.3:0/1421237855 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a8009a70 con 0x7f95b00bdd60 2023-03-06T14:16:18.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.458+0000 7f95b5435700 1 --2- 172.21.15.3:0/1421237855 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95b00bdd60 0x7f95b0152170 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f95a800b370 tx=0x7f95a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:18.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.458+0000 7f95ad7fa700 1 -- 172.21.15.3:0/1421237855 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8007000 con 0x7f95b00bdd60 2023-03-06T14:16:18.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.458+0000 7f95ad7fa700 1 -- 172.21.15.3:0/1421237855 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a8012650 con 0x7f95b00bdd60 2023-03-06T14:16:18.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.458+0000 7f95b6e98700 1 -- 172.21.15.3:0/1421237855 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b0150220 con 0x7f95b00bdd60 2023-03-06T14:16:18.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.458+0000 7f95ad7fa700 1 -- 172.21.15.3:0/1421237855 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8012a00 con 0x7f95b00bdd60 2023-03-06T14:16:18.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.458+0000 7f95b6e98700 1 -- 172.21.15.3:0/1421237855 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b00bd150 con 0x7f95b00bdd60 2023-03-06T14:16:18.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.459+0000 7f95b6e98700 1 -- 172.21.15.3:0/1421237855 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b00b8b80 con 0x7f95b00bdd60 2023-03-06T14:16:18.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.459+0000 7f95ad7fa700 1 -- 172.21.15.3:0/1421237855 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f95a8012b60 con 0x7f95b00bdd60 2023-03-06T14:16:18.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.460+0000 7f95ad7fa700 1 --2- 172.21.15.3:0/1421237855 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f95940682f0 0x7f959406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:18.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.460+0000 7f95ad7fa700 1 -- 172.21.15.3:0/1421237855 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f95a80881f0 con 0x7f95b00bdd60 2023-03-06T14:16:18.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.460+0000 7f95b4c34700 1 --2- 172.21.15.3:0/1421237855 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f95940682f0 0x7f959406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:18.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.460+0000 7f95b4c34700 1 --2- 172.21.15.3:0/1421237855 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f95940682f0 0x7f959406a7a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f95a4007fd0 tx=0x7f95a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:18.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.464+0000 7f95ad7fa700 1 -- 172.21.15.3:0/1421237855 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f95a8054760 con 0x7f95b00bdd60 2023-03-06T14:16:18.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.656+0000 7f95b6e98700 1 -- 172.21.15.3:0/1421237855 --> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f95b014cdc0 con 0x7f95940682f0 2023-03-06T14:16:18.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.666+0000 7f95ad7fa700 1 -- 172.21.15.3:0/1421237855 <== mgr.4107 v2:172.21.15.136:6832/96144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367268 (secure 0 0 0) 0x7f95b014cdc0 con 0x7f95940682f0 2023-03-06T14:16:18.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:18.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.669+0000 7f95b6e98700 1 -- 172.21.15.3:0/1421237855 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f95940682f0 msgr2=0x7f959406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:18.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.670+0000 7f95b6e98700 1 --2- 172.21.15.3:0/1421237855 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f95940682f0 0x7f959406a7a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f95a4007fd0 tx=0x7f95a4009040 comp rx=0 tx=0).stop 2023-03-06T14:16:18.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.670+0000 7f95b6e98700 1 -- 172.21.15.3:0/1421237855 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95b00bdd60 msgr2=0x7f95b0152170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:18.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.670+0000 7f95b6e98700 1 --2- 172.21.15.3:0/1421237855 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95b00bdd60 0x7f95b0152170 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f95a800b370 tx=0x7f95a8004ad0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.670+0000 7f95b6e98700 1 -- 172.21.15.3:0/1421237855 shutdown_connections 2023-03-06T14:16:18.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.670+0000 7f95b6e98700 1 --2- 172.21.15.3:0/1421237855 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f95940682f0 0x7f959406a7a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.670+0000 7f95b6e98700 1 --2- 172.21.15.3:0/1421237855 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95b00bdd60 0x7f95b0152170 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.670+0000 7f95b6e98700 1 --2- 172.21.15.3:0/1421237855 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f95b006ea70 0x7f95b01e7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.670+0000 7f95b6e98700 1 --2- 172.21.15.3:0/1421237855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95b006ee40 0x7f95b0151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.670+0000 7f95b6e98700 1 -- 172.21.15.3:0/1421237855 >> 172.21.15.3:0/1421237855 conn(0x7f95b00c2150 msgr2=0x7f95b006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:18.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.670+0000 7f95b6e98700 1 -- 172.21.15.3:0/1421237855 shutdown_connections 2023-03-06T14:16:18.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.670+0000 7f95b6e98700 1 -- 172.21.15.3:0/1421237855 wait complete. 2023-03-06T14:16:18.675 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-03-06T14:16:18.683 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-03-06T14:16:16.968840+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594896,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67496,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907224,"statfs":{"total":773094113280,"available":773024997376,"internally_reserved":0,"allocated":3579904,"data_stored":2148859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2198,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003417"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633630+0000","last_change":"2023-03-06T14:15:58.616190+0000","last_active":"2023-03-06T14:16:02.633630+0000","last_peered":"2023-03-06T14:16:02.633630+0000","last_clean":"2023-03-06T14:16:02.633630+0000","last_became_active":"2023-03-06T14:15:58.615955+0000","last_became_peered":"2023-03-06T14:15:58.615955+0000","last_unstale":"2023-03-06T14:16:02.633630+0000","last_undegraded":"2023-03-06T14:16:02.633630+0000","last_fullsized":"2023-03-06T14:16:02.633630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:30:51.239540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622862+0000","last_change":"2023-03-06T14:15:58.627806+0000","last_active":"2023-03-06T14:16:02.622862+0000","last_peered":"2023-03-06T14:16:02.622862+0000","last_clean":"2023-03-06T14:16:02.622862+0000","last_became_active":"2023-03-06T14:15:58.627569+0000","last_became_peered":"2023-03-06T14:15:58.627569+0000","last_unstale":"2023-03-06T14:16:02.622862+0000","last_undegraded":"2023-03-06T14:16:02.622862+0000","last_fullsized":"2023-03-06T14:16:02.622862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:11:22.678656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.624921+0000","last_change":"2023-03-06T14:15:58.620909+0000","last_active":"2023-03-06T14:16:02.624921+0000","last_peered":"2023-03-06T14:16:02.624921+0000","last_clean":"2023-03-06T14:16:02.624921+0000","last_became_active":"2023-03-06T14:15:58.620552+0000","last_became_peered":"2023-03-06T14:15:58.620552+0000","last_unstale":"2023-03-06T14:16:02.624921+0000","last_undegraded":"2023-03-06T14:16:02.624921+0000","last_fullsized":"2023-03-06T14:16:02.624921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:20:36.299681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.627858+0000","last_change":"2023-03-06T14:15:58.620841+0000","last_active":"2023-03-06T14:16:02.627858+0000","last_peered":"2023-03-06T14:16:02.627858+0000","last_clean":"2023-03-06T14:16:02.627858+0000","last_became_active":"2023-03-06T14:15:58.620520+0000","last_became_peered":"2023-03-06T14:15:58.620520+0000","last_unstale":"2023-03-06T14:16:02.627858+0000","last_undegraded":"2023-03-06T14:16:02.627858+0000","last_fullsized":"2023-03-06T14:16:02.627858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:48:05.347666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.634738+0000","last_change":"2023-03-06T14:15:58.617864+0000","last_active":"2023-03-06T14:16:02.634738+0000","last_peered":"2023-03-06T14:16:02.634738+0000","last_clean":"2023-03-06T14:16:02.634738+0000","last_became_active":"2023-03-06T14:15:58.617583+0000","last_became_peered":"2023-03-06T14:15:58.617583+0000","last_unstale":"2023-03-06T14:16:02.634738+0000","last_undegraded":"2023-03-06T14:16:02.634738+0000","last_fullsized":"2023-03-06T14:16:02.634738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:38.013992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623747+0000","last_change":"2023-03-06T14:15:58.622023+0000","last_active":"2023-03-06T14:16:02.623747+0000","last_peered":"2023-03-06T14:16:02.623747+0000","last_clean":"2023-03-06T14:16:02.623747+0000","last_became_active":"2023-03-06T14:15:58.621701+0000","last_became_peered":"2023-03-06T14:15:58.621701+0000","last_unstale":"2023-03-06T14:16:02.623747+0000","last_undegraded":"2023-03-06T14:16:02.623747+0000","last_fullsized":"2023-03-06T14:16:02.623747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:30:29.679092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633939+0000","last_change":"2023-03-06T14:15:58.628504+0000","last_active":"2023-03-06T14:16:02.633939+0000","last_peered":"2023-03-06T14:16:02.633939+0000","last_clean":"2023-03-06T14:16:02.633939+0000","last_became_active":"2023-03-06T14:15:58.625498+0000","last_became_peered":"2023-03-06T14:15:58.625498+0000","last_unstale":"2023-03-06T14:16:02.633939+0000","last_undegraded":"2023-03-06T14:16:02.633939+0000","last_fullsized":"2023-03-06T14:16:02.633939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621014+0000","last_change":"2023-03-06T14:15:58.623919+0000","last_active":"2023-03-06T14:16:02.621014+0000","last_peered":"2023-03-06T14:16:02.621014+0000","last_clean":"2023-03-06T14:16:02.621014+0000","last_became_active":"2023-03-06T14:15:58.623649+0000","last_became_peered":"2023-03-06T14:15:58.623649+0000","last_unstale":"2023-03-06T14:16:02.621014+0000","last_undegraded":"2023-03-06T14:16:02.621014+0000","last_fullsized":"2023-03-06T14:16:02.621014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633659+0000","last_change":"2023-03-06T14:15:58.620112+0000","last_active":"2023-03-06T14:16:02.633659+0000","last_peered":"2023-03-06T14:16:02.633659+0000","last_clean":"2023-03-06T14:16:02.633659+0000","last_became_active":"2023-03-06T14:15:58.619883+0000","last_became_peered":"2023-03-06T14:15:58.619883+0000","last_unstale":"2023-03-06T14:16:02.633659+0000","last_undegraded":"2023-03-06T14:16:02.633659+0000","last_fullsized":"2023-03-06T14:16:02.633659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:37:30.914574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622801+0000","last_change":"2023-03-06T14:15:58.621910+0000","last_active":"2023-03-06T14:16:02.622801+0000","last_peered":"2023-03-06T14:16:02.622801+0000","last_clean":"2023-03-06T14:16:02.622801+0000","last_became_active":"2023-03-06T14:15:58.621587+0000","last_became_peered":"2023-03-06T14:15:58.621587+0000","last_unstale":"2023-03-06T14:16:02.622801+0000","last_undegraded":"2023-03-06T14:16:02.622801+0000","last_fullsized":"2023-03-06T14:16:02.622801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:38.013992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.624901+0000","last_change":"2023-03-06T14:15:58.624755+0000","last_active":"2023-03-06T14:16:02.624901+0000","last_peered":"2023-03-06T14:16:02.624901+0000","last_clean":"2023-03-06T14:16:02.624901+0000","last_became_active":"2023-03-06T14:15:58.624475+0000","last_became_peered":"2023-03-06T14:15:58.624475+0000","last_unstale":"2023-03-06T14:16:02.624901+0000","last_undegraded":"2023-03-06T14:16:02.624901+0000","last_fullsized":"2023-03-06T14:16:02.624901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:18:07.721373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633699+0000","last_change":"2023-03-06T14:15:58.614740+0000","last_active":"2023-03-06T14:16:02.633699+0000","last_peered":"2023-03-06T14:16:02.633699+0000","last_clean":"2023-03-06T14:16:02.633699+0000","last_became_active":"2023-03-06T14:15:58.614438+0000","last_became_peered":"2023-03-06T14:15:58.614438+0000","last_unstale":"2023-03-06T14:16:02.633699+0000","last_undegraded":"2023-03-06T14:16:02.633699+0000","last_fullsized":"2023-03-06T14:16:02.633699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:01:52.021250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633994+0000","last_change":"2023-03-06T14:15:58.616660+0000","last_active":"2023-03-06T14:16:02.633994+0000","last_peered":"2023-03-06T14:16:02.633994+0000","last_clean":"2023-03-06T14:16:02.633994+0000","last_became_active":"2023-03-06T14:15:58.616421+0000","last_became_peered":"2023-03-06T14:15:58.616421+0000","last_unstale":"2023-03-06T14:16:02.633994+0000","last_undegraded":"2023-03-06T14:16:02.633994+0000","last_fullsized":"2023-03-06T14:16:02.633994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:36.384280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620650+0000","last_change":"2023-03-06T14:15:58.621829+0000","last_active":"2023-03-06T14:16:02.620650+0000","last_peered":"2023-03-06T14:16:02.620650+0000","last_clean":"2023-03-06T14:16:02.620650+0000","last_became_active":"2023-03-06T14:15:58.621536+0000","last_became_peered":"2023-03-06T14:15:58.621536+0000","last_unstale":"2023-03-06T14:16:02.620650+0000","last_undegraded":"2023-03-06T14:16:02.620650+0000","last_fullsized":"2023-03-06T14:16:02.620650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:07:29.050347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633730+0000","last_change":"2023-03-06T14:15:58.628671+0000","last_active":"2023-03-06T14:16:02.633730+0000","last_peered":"2023-03-06T14:16:02.633730+0000","last_clean":"2023-03-06T14:16:02.633730+0000","last_became_active":"2023-03-06T14:15:58.625890+0000","last_became_peered":"2023-03-06T14:15:58.625890+0000","last_unstale":"2023-03-06T14:16:02.633730+0000","last_undegraded":"2023-03-06T14:16:02.633730+0000","last_fullsized":"2023-03-06T14:16:02.633730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:52:46.916668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621598+0000","last_change":"2023-03-06T14:15:58.619050+0000","last_active":"2023-03-06T14:16:02.621598+0000","last_peered":"2023-03-06T14:16:02.621598+0000","last_clean":"2023-03-06T14:16:02.621598+0000","last_became_active":"2023-03-06T14:15:58.618773+0000","last_became_peered":"2023-03-06T14:15:58.618773+0000","last_unstale":"2023-03-06T14:16:02.621598+0000","last_undegraded":"2023-03-06T14:16:02.621598+0000","last_fullsized":"2023-03-06T14:16:02.621598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:02.198113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633760+0000","last_change":"2023-03-06T14:15:58.618365+0000","last_active":"2023-03-06T14:16:02.633760+0000","last_peered":"2023-03-06T14:16:02.633760+0000","last_clean":"2023-03-06T14:16:02.633760+0000","last_became_active":"2023-03-06T14:15:58.618051+0000","last_became_peered":"2023-03-06T14:15:58.618051+0000","last_unstale":"2023-03-06T14:16:02.633760+0000","last_undegraded":"2023-03-06T14:16:02.633760+0000","last_fullsized":"2023-03-06T14:16:02.633760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.625083+0000","last_change":"2023-03-06T14:15:58.619631+0000","last_active":"2023-03-06T14:16:02.625083+0000","last_peered":"2023-03-06T14:16:02.625083+0000","last_clean":"2023-03-06T14:16:02.625083+0000","last_became_active":"2023-03-06T14:15:58.619269+0000","last_became_peered":"2023-03-06T14:15:58.619269+0000","last_unstale":"2023-03-06T14:16:02.625083+0000","last_undegraded":"2023-03-06T14:16:02.625083+0000","last_fullsized":"2023-03-06T14:16:02.625083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:37:25.467445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633840+0000","last_change":"2023-03-06T14:15:58.626814+0000","last_active":"2023-03-06T14:16:02.633840+0000","last_peered":"2023-03-06T14:16:02.633840+0000","last_clean":"2023-03-06T14:16:02.633840+0000","last_became_active":"2023-03-06T14:15:58.626375+0000","last_became_peered":"2023-03-06T14:15:58.626375+0000","last_unstale":"2023-03-06T14:16:02.633840+0000","last_undegraded":"2023-03-06T14:16:02.633840+0000","last_fullsized":"2023-03-06T14:16:02.633840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:52.649365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.624599+0000","last_change":"2023-03-06T14:15:58.612672+0000","last_active":"2023-03-06T14:16:02.624599+0000","last_peered":"2023-03-06T14:16:02.624599+0000","last_clean":"2023-03-06T14:16:02.624599+0000","last_became_active":"2023-03-06T14:15:58.612397+0000","last_became_peered":"2023-03-06T14:15:58.612397+0000","last_unstale":"2023-03-06T14:16:02.624599+0000","last_undegraded":"2023-03-06T14:16:02.624599+0000","last_fullsized":"2023-03-06T14:16:02.624599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:11:35.054920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631524+0000","last_change":"2023-03-06T14:15:58.633204+0000","last_active":"2023-03-06T14:16:02.631524+0000","last_peered":"2023-03-06T14:16:02.631524+0000","last_clean":"2023-03-06T14:16:02.631524+0000","last_became_active":"2023-03-06T14:15:58.632916+0000","last_became_peered":"2023-03-06T14:15:58.632916+0000","last_unstale":"2023-03-06T14:16:02.631524+0000","last_undegraded":"2023-03-06T14:16:02.631524+0000","last_fullsized":"2023-03-06T14:16:02.631524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.626753+0000","last_change":"2023-03-06T14:15:58.626811+0000","last_active":"2023-03-06T14:16:02.626753+0000","last_peered":"2023-03-06T14:16:02.626753+0000","last_clean":"2023-03-06T14:16:02.626753+0000","last_became_active":"2023-03-06T14:15:58.626343+0000","last_became_peered":"2023-03-06T14:15:58.626343+0000","last_unstale":"2023-03-06T14:16:02.626753+0000","last_undegraded":"2023-03-06T14:16:02.626753+0000","last_fullsized":"2023-03-06T14:16:02.626753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:38:05.275651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620103+0000","last_change":"2023-03-06T14:15:58.619060+0000","last_active":"2023-03-06T14:16:02.620103+0000","last_peered":"2023-03-06T14:16:02.620103+0000","last_clean":"2023-03-06T14:16:02.620103+0000","last_became_active":"2023-03-06T14:15:58.618364+0000","last_became_peered":"2023-03-06T14:15:58.618364+0000","last_unstale":"2023-03-06T14:16:02.620103+0000","last_undegraded":"2023-03-06T14:16:02.620103+0000","last_fullsized":"2023-03-06T14:16:02.620103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:10:40.167591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631039+0000","last_change":"2023-03-06T14:15:58.633217+0000","last_active":"2023-03-06T14:16:02.631039+0000","last_peered":"2023-03-06T14:16:02.631039+0000","last_clean":"2023-03-06T14:16:02.631039+0000","last_became_active":"2023-03-06T14:15:58.632914+0000","last_became_peered":"2023-03-06T14:15:58.632914+0000","last_unstale":"2023-03-06T14:16:02.631039+0000","last_undegraded":"2023-03-06T14:16:02.631039+0000","last_fullsized":"2023-03-06T14:16:02.631039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637804+0000","last_change":"2023-03-06T14:15:58.623997+0000","last_active":"2023-03-06T14:16:02.637804+0000","last_peered":"2023-03-06T14:16:02.637804+0000","last_clean":"2023-03-06T14:16:02.637804+0000","last_became_active":"2023-03-06T14:15:58.623647+0000","last_became_peered":"2023-03-06T14:15:58.623647+0000","last_unstale":"2023-03-06T14:16:02.637804+0000","last_undegraded":"2023-03-06T14:16:02.637804+0000","last_fullsized":"2023-03-06T14:16:02.637804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:07:29.050347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637576+0000","last_change":"2023-03-06T14:15:58.627972+0000","last_active":"2023-03-06T14:16:02.637576+0000","last_peered":"2023-03-06T14:16:02.637576+0000","last_clean":"2023-03-06T14:16:02.637576+0000","last_became_active":"2023-03-06T14:15:58.624590+0000","last_became_peered":"2023-03-06T14:15:58.624590+0000","last_unstale":"2023-03-06T14:16:02.637576+0000","last_undegraded":"2023-03-06T14:16:02.637576+0000","last_fullsized":"2023-03-06T14:16:02.637576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623548+0000","last_change":"2023-03-06T14:15:58.630237+0000","last_active":"2023-03-06T14:16:02.623548+0000","last_peered":"2023-03-06T14:16:02.623548+0000","last_clean":"2023-03-06T14:16:02.623548+0000","last_became_active":"2023-03-06T14:15:58.629950+0000","last_became_peered":"2023-03-06T14:15:58.629950+0000","last_unstale":"2023-03-06T14:16:02.623548+0000","last_undegraded":"2023-03-06T14:16:02.623548+0000","last_fullsized":"2023-03-06T14:16:02.623548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.355023+0000","last_change":"2023-03-06T14:16:02.646596+0000","last_active":"2023-03-06T14:16:03.355023+0000","last_peered":"2023-03-06T14:16:03.355023+0000","last_clean":"2023-03-06T14:16:03.355023+0000","last_became_active":"2023-03-06T14:16:02.646087+0000","last_became_peered":"2023-03-06T14:16:02.646087+0000","last_unstale":"2023-03-06T14:16:03.355023+0000","last_undegraded":"2023-03-06T14:16:03.355023+0000","last_fullsized":"2023-03-06T14:16:03.355023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:06:47.997273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623579+0000","last_change":"2023-03-06T14:15:58.199019+0000","last_active":"2023-03-06T14:16:02.623579+0000","last_peered":"2023-03-06T14:16:02.623579+0000","last_clean":"2023-03-06T14:16:02.623579+0000","last_became_active":"2023-03-06T14:15:58.198549+0000","last_became_peered":"2023-03-06T14:15:58.198549+0000","last_unstale":"2023-03-06T14:16:02.623579+0000","last_undegraded":"2023-03-06T14:16:02.623579+0000","last_fullsized":"2023-03-06T14:16:02.623579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:38:41.806931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620438+0000","last_change":"2023-03-06T14:15:58.624265+0000","last_active":"2023-03-06T14:16:02.620438+0000","last_peered":"2023-03-06T14:16:02.620438+0000","last_clean":"2023-03-06T14:16:02.620438+0000","last_became_active":"2023-03-06T14:15:58.624013+0000","last_became_peered":"2023-03-06T14:15:58.624013+0000","last_unstale":"2023-03-06T14:16:02.620438+0000","last_undegraded":"2023-03-06T14:16:02.620438+0000","last_fullsized":"2023-03-06T14:16:02.620438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:38.013992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046786+0000","last_change":"2023-03-06T14:16:02.636774+0000","last_active":"2023-03-06T14:16:03.046786+0000","last_peered":"2023-03-06T14:16:03.046786+0000","last_clean":"2023-03-06T14:16:03.046786+0000","last_became_active":"2023-03-06T14:16:02.636419+0000","last_became_peered":"2023-03-06T14:16:02.636419+0000","last_unstale":"2023-03-06T14:16:03.046786+0000","last_undegraded":"2023-03-06T14:16:03.046786+0000","last_fullsized":"2023-03-06T14:16:03.046786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:11:50.112514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.636039+0000","last_change":"2023-03-06T14:15:58.193447+0000","last_active":"2023-03-06T14:16:02.636039+0000","last_peered":"2023-03-06T14:16:02.636039+0000","last_clean":"2023-03-06T14:16:02.636039+0000","last_became_active":"2023-03-06T14:15:58.193156+0000","last_became_peered":"2023-03-06T14:15:58.193156+0000","last_unstale":"2023-03-06T14:16:02.636039+0000","last_undegraded":"2023-03-06T14:16:02.636039+0000","last_fullsized":"2023-03-06T14:16:02.636039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:01:51.926759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631312+0000","last_change":"2023-03-06T14:15:58.631829+0000","last_active":"2023-03-06T14:16:02.631312+0000","last_peered":"2023-03-06T14:16:02.631312+0000","last_clean":"2023-03-06T14:16:02.631312+0000","last_became_active":"2023-03-06T14:15:58.631539+0000","last_became_peered":"2023-03-06T14:15:58.631539+0000","last_unstale":"2023-03-06T14:16:02.631312+0000","last_undegraded":"2023-03-06T14:16:02.631312+0000","last_fullsized":"2023-03-06T14:16:02.631312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:07:29.050347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.152775+0000","last_change":"2023-03-06T14:16:02.651029+0000","last_active":"2023-03-06T14:16:03.152775+0000","last_peered":"2023-03-06T14:16:03.152775+0000","last_clean":"2023-03-06T14:16:03.152775+0000","last_became_active":"2023-03-06T14:16:02.647451+0000","last_became_peered":"2023-03-06T14:16:02.647451+0000","last_unstale":"2023-03-06T14:16:03.152775+0000","last_undegraded":"2023-03-06T14:16:03.152775+0000","last_fullsized":"2023-03-06T14:16:03.152775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:42:32.218248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620790+0000","last_change":"2023-03-06T14:15:58.199612+0000","last_active":"2023-03-06T14:16:02.620790+0000","last_peered":"2023-03-06T14:16:02.620790+0000","last_clean":"2023-03-06T14:16:02.620790+0000","last_became_active":"2023-03-06T14:15:58.199287+0000","last_became_peered":"2023-03-06T14:15:58.199287+0000","last_unstale":"2023-03-06T14:16:02.620790+0000","last_undegraded":"2023-03-06T14:16:02.620790+0000","last_fullsized":"2023-03-06T14:16:02.620790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:01:51.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628754+0000","last_change":"2023-03-06T14:15:58.623084+0000","last_active":"2023-03-06T14:16:02.628754+0000","last_peered":"2023-03-06T14:16:02.628754+0000","last_clean":"2023-03-06T14:16:02.628754+0000","last_became_active":"2023-03-06T14:15:58.622619+0000","last_became_peered":"2023-03-06T14:15:58.622619+0000","last_unstale":"2023-03-06T14:16:02.628754+0000","last_undegraded":"2023-03-06T14:16:02.628754+0000","last_fullsized":"2023-03-06T14:16:02.628754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:55:43.155483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046240+0000","last_change":"2023-03-06T14:16:02.649807+0000","last_active":"2023-03-06T14:16:03.046240+0000","last_peered":"2023-03-06T14:16:03.046240+0000","last_clean":"2023-03-06T14:16:03.046240+0000","last_became_active":"2023-03-06T14:16:02.649413+0000","last_became_peered":"2023-03-06T14:16:02.649413+0000","last_unstale":"2023-03-06T14:16:03.046240+0000","last_undegraded":"2023-03-06T14:16:03.046240+0000","last_fullsized":"2023-03-06T14:16:03.046240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:21:53.710722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633850+0000","last_change":"2023-03-06T14:15:58.198905+0000","last_active":"2023-03-06T14:16:02.633850+0000","last_peered":"2023-03-06T14:16:02.633850+0000","last_clean":"2023-03-06T14:16:02.633850+0000","last_became_active":"2023-03-06T14:15:58.198283+0000","last_became_peered":"2023-03-06T14:15:58.198283+0000","last_unstale":"2023-03-06T14:16:02.633850+0000","last_undegraded":"2023-03-06T14:16:02.633850+0000","last_fullsized":"2023-03-06T14:16:02.633850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:51.640135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620677+0000","last_change":"2023-03-06T14:15:58.629610+0000","last_active":"2023-03-06T14:16:02.620677+0000","last_peered":"2023-03-06T14:16:02.620677+0000","last_clean":"2023-03-06T14:16:02.620677+0000","last_became_active":"2023-03-06T14:15:58.629363+0000","last_became_peered":"2023-03-06T14:15:58.629363+0000","last_unstale":"2023-03-06T14:16:02.620677+0000","last_undegraded":"2023-03-06T14:16:02.620677+0000","last_fullsized":"2023-03-06T14:16:02.620677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.354086+0000","last_change":"2023-03-06T14:16:02.648003+0000","last_active":"2023-03-06T14:16:03.354086+0000","last_peered":"2023-03-06T14:16:03.354086+0000","last_clean":"2023-03-06T14:16:03.354086+0000","last_became_active":"2023-03-06T14:16:02.647584+0000","last_became_peered":"2023-03-06T14:16:02.647584+0000","last_unstale":"2023-03-06T14:16:03.354086+0000","last_undegraded":"2023-03-06T14:16:03.354086+0000","last_fullsized":"2023-03-06T14:16:03.354086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:07:43.686453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622697+0000","last_change":"2023-03-06T14:15:58.196508+0000","last_active":"2023-03-06T14:16:02.622697+0000","last_peered":"2023-03-06T14:16:02.622697+0000","last_clean":"2023-03-06T14:16:02.622697+0000","last_became_active":"2023-03-06T14:15:58.196196+0000","last_became_peered":"2023-03-06T14:15:58.196196+0000","last_unstale":"2023-03-06T14:16:02.622697+0000","last_undegraded":"2023-03-06T14:16:02.622697+0000","last_fullsized":"2023-03-06T14:16:02.622697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:35.375050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620110+0000","last_change":"2023-03-06T14:15:58.630871+0000","last_active":"2023-03-06T14:16:02.620110+0000","last_peered":"2023-03-06T14:16:02.620110+0000","last_clean":"2023-03-06T14:16:02.620110+0000","last_became_active":"2023-03-06T14:15:58.630600+0000","last_became_peered":"2023-03-06T14:15:58.630600+0000","last_unstale":"2023-03-06T14:16:02.620110+0000","last_undegraded":"2023-03-06T14:16:02.620110+0000","last_fullsized":"2023-03-06T14:16:02.620110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:11:46.673965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046607+0000","last_change":"2023-03-06T14:16:02.647406+0000","last_active":"2023-03-06T14:16:03.046607+0000","last_peered":"2023-03-06T14:16:03.046607+0000","last_clean":"2023-03-06T14:16:03.046607+0000","last_became_active":"2023-03-06T14:16:02.646991+0000","last_became_peered":"2023-03-06T14:16:02.646991+0000","last_unstale":"2023-03-06T14:16:03.046607+0000","last_undegraded":"2023-03-06T14:16:03.046607+0000","last_fullsized":"2023-03-06T14:16:03.046607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:08:18.196610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631874+0000","last_change":"2023-03-06T14:15:58.203832+0000","last_active":"2023-03-06T14:16:02.631874+0000","last_peered":"2023-03-06T14:16:02.631874+0000","last_clean":"2023-03-06T14:16:02.631874+0000","last_became_active":"2023-03-06T14:15:58.202151+0000","last_became_peered":"2023-03-06T14:15:58.202151+0000","last_unstale":"2023-03-06T14:16:02.631874+0000","last_undegraded":"2023-03-06T14:16:02.631874+0000","last_fullsized":"2023-03-06T14:16:02.631874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:48:04.338436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637281+0000","last_change":"2023-03-06T14:15:58.623887+0000","last_active":"2023-03-06T14:16:02.637281+0000","last_peered":"2023-03-06T14:16:02.637281+0000","last_clean":"2023-03-06T14:16:02.637281+0000","last_became_active":"2023-03-06T14:15:58.623588+0000","last_became_peered":"2023-03-06T14:15:58.623588+0000","last_unstale":"2023-03-06T14:16:02.637281+0000","last_undegraded":"2023-03-06T14:16:02.637281+0000","last_fullsized":"2023-03-06T14:16:02.637281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:07:29.725804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.154947+0000","last_change":"2023-03-06T14:16:02.640486+0000","last_active":"2023-03-06T14:16:03.154947+0000","last_peered":"2023-03-06T14:16:03.154947+0000","last_clean":"2023-03-06T14:16:03.154947+0000","last_became_active":"2023-03-06T14:16:02.640118+0000","last_became_peered":"2023-03-06T14:16:02.640118+0000","last_unstale":"2023-03-06T14:16:03.154947+0000","last_undegraded":"2023-03-06T14:16:03.154947+0000","last_fullsized":"2023-03-06T14:16:03.154947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:27:58.703596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:14.065253+0000","last_change":"2023-03-06T14:15:58.192763+0000","last_active":"2023-03-06T14:16:14.065253+0000","last_peered":"2023-03-06T14:16:14.065253+0000","last_clean":"2023-03-06T14:16:14.065253+0000","last_became_active":"2023-03-06T14:15:58.192461+0000","last_became_peered":"2023-03-06T14:15:58.192461+0000","last_unstale":"2023-03-06T14:16:14.065253+0000","last_undegraded":"2023-03-06T14:16:14.065253+0000","last_fullsized":"2023-03-06T14:16:14.065253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:29:15.572837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3746,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623479+0000","last_change":"2023-03-06T14:15:58.617934+0000","last_active":"2023-03-06T14:16:02.623479+0000","last_peered":"2023-03-06T14:16:02.623479+0000","last_clean":"2023-03-06T14:16:02.623479+0000","last_became_active":"2023-03-06T14:15:58.617387+0000","last_became_peered":"2023-03-06T14:15:58.617387+0000","last_unstale":"2023-03-06T14:16:02.623479+0000","last_undegraded":"2023-03-06T14:16:02.623479+0000","last_fullsized":"2023-03-06T14:16:02.623479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:18:06.098146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045480+0000","last_change":"2023-03-06T14:16:02.648850+0000","last_active":"2023-03-06T14:16:03.045480+0000","last_peered":"2023-03-06T14:16:03.045480+0000","last_clean":"2023-03-06T14:16:03.045480+0000","last_became_active":"2023-03-06T14:16:02.648464+0000","last_became_peered":"2023-03-06T14:16:02.648464+0000","last_unstale":"2023-03-06T14:16:03.045480+0000","last_undegraded":"2023-03-06T14:16:03.045480+0000","last_fullsized":"2023-03-06T14:16:03.045480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:36:04.845196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631439+0000","last_change":"2023-03-06T14:15:58.196704+0000","last_active":"2023-03-06T14:16:02.631439+0000","last_peered":"2023-03-06T14:16:02.631439+0000","last_clean":"2023-03-06T14:16:02.631439+0000","last_became_active":"2023-03-06T14:15:58.196420+0000","last_became_peered":"2023-03-06T14:15:58.196420+0000","last_unstale":"2023-03-06T14:16:02.631439+0000","last_undegraded":"2023-03-06T14:16:02.631439+0000","last_fullsized":"2023-03-06T14:16:02.631439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:30:50.230310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620609+0000","last_change":"2023-03-06T14:15:58.624384+0000","last_active":"2023-03-06T14:16:02.620609+0000","last_peered":"2023-03-06T14:16:02.620609+0000","last_clean":"2023-03-06T14:16:02.620609+0000","last_became_active":"2023-03-06T14:15:58.624104+0000","last_became_peered":"2023-03-06T14:15:58.624104+0000","last_unstale":"2023-03-06T14:16:02.620609+0000","last_undegraded":"2023-03-06T14:16:02.620609+0000","last_fullsized":"2023-03-06T14:16:02.620609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046476+0000","last_change":"2023-03-06T14:16:02.649893+0000","last_active":"2023-03-06T14:16:03.046476+0000","last_peered":"2023-03-06T14:16:03.046476+0000","last_clean":"2023-03-06T14:16:03.046476+0000","last_became_active":"2023-03-06T14:16:02.649449+0000","last_became_peered":"2023-03-06T14:16:02.649449+0000","last_unstale":"2023-03-06T14:16:03.046476+0000","last_undegraded":"2023-03-06T14:16:03.046476+0000","last_fullsized":"2023-03-06T14:16:03.046476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:16:47.318848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.626428+0000","last_change":"2023-03-06T14:15:58.199816+0000","last_active":"2023-03-06T14:16:02.626428+0000","last_peered":"2023-03-06T14:16:02.626428+0000","last_clean":"2023-03-06T14:16:02.626428+0000","last_became_active":"2023-03-06T14:15:58.198949+0000","last_became_peered":"2023-03-06T14:15:58.198949+0000","last_unstale":"2023-03-06T14:16:02.626428+0000","last_undegraded":"2023-03-06T14:16:02.626428+0000","last_fullsized":"2023-03-06T14:16:02.626428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:38:41.806931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623461+0000","last_change":"2023-03-06T14:15:58.630195+0000","last_active":"2023-03-06T14:16:02.623461+0000","last_peered":"2023-03-06T14:16:02.623461+0000","last_clean":"2023-03-06T14:16:02.623461+0000","last_became_active":"2023-03-06T14:15:58.629926+0000","last_became_peered":"2023-03-06T14:15:58.629926+0000","last_unstale":"2023-03-06T14:16:02.623461+0000","last_undegraded":"2023-03-06T14:16:02.623461+0000","last_fullsized":"2023-03-06T14:16:02.623461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046473+0000","last_change":"2023-03-06T14:16:02.650159+0000","last_active":"2023-03-06T14:16:03.046473+0000","last_peered":"2023-03-06T14:16:03.046473+0000","last_clean":"2023-03-06T14:16:03.046473+0000","last_became_active":"2023-03-06T14:16:02.649734+0000","last_became_peered":"2023-03-06T14:16:02.649734+0000","last_unstale":"2023-03-06T14:16:03.046473+0000","last_undegraded":"2023-03-06T14:16:03.046473+0000","last_fullsized":"2023-03-06T14:16:03.046473+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:12:39.833476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633836+0000","last_change":"2023-03-06T14:15:58.197641+0000","last_active":"2023-03-06T14:16:02.633836+0000","last_peered":"2023-03-06T14:16:02.633836+0000","last_clean":"2023-03-06T14:16:02.633836+0000","last_became_active":"2023-03-06T14:15:58.197332+0000","last_became_peered":"2023-03-06T14:15:58.197332+0000","last_unstale":"2023-03-06T14:16:02.633836+0000","last_undegraded":"2023-03-06T14:16:02.633836+0000","last_fullsized":"2023-03-06T14:16:02.633836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:42:02.415337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631395+0000","last_change":"2023-03-06T14:15:58.619271+0000","last_active":"2023-03-06T14:16:02.631395+0000","last_peered":"2023-03-06T14:16:02.631395+0000","last_clean":"2023-03-06T14:16:02.631395+0000","last_became_active":"2023-03-06T14:15:58.618980+0000","last_became_peered":"2023-03-06T14:15:58.618980+0000","last_unstale":"2023-03-06T14:16:02.631395+0000","last_undegraded":"2023-03-06T14:16:02.631395+0000","last_fullsized":"2023-03-06T14:16:02.631395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045038+0000","last_change":"2023-03-06T14:16:02.641990+0000","last_active":"2023-03-06T14:16:03.045038+0000","last_peered":"2023-03-06T14:16:03.045038+0000","last_clean":"2023-03-06T14:16:03.045038+0000","last_became_active":"2023-03-06T14:16:02.641619+0000","last_became_peered":"2023-03-06T14:16:02.641619+0000","last_unstale":"2023-03-06T14:16:03.045038+0000","last_undegraded":"2023-03-06T14:16:03.045038+0000","last_fullsized":"2023-03-06T14:16:03.045038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:07:17.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628320+0000","last_change":"2023-03-06T14:15:58.199278+0000","last_active":"2023-03-06T14:16:02.628320+0000","last_peered":"2023-03-06T14:16:02.628320+0000","last_clean":"2023-03-06T14:16:02.628320+0000","last_became_active":"2023-03-06T14:15:58.198946+0000","last_became_peered":"2023-03-06T14:15:58.198946+0000","last_unstale":"2023-03-06T14:16:02.628320+0000","last_undegraded":"2023-03-06T14:16:02.628320+0000","last_fullsized":"2023-03-06T14:16:02.628320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:56:39.417304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621143+0000","last_change":"2023-03-06T14:15:58.630272+0000","last_active":"2023-03-06T14:16:02.621143+0000","last_peered":"2023-03-06T14:16:02.621143+0000","last_clean":"2023-03-06T14:16:02.621143+0000","last_became_active":"2023-03-06T14:15:58.630009+0000","last_became_peered":"2023-03-06T14:15:58.630009+0000","last_unstale":"2023-03-06T14:16:02.621143+0000","last_undegraded":"2023-03-06T14:16:02.621143+0000","last_fullsized":"2023-03-06T14:16:02.621143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:11:35.054920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.355117+0000","last_change":"2023-03-06T14:16:02.640631+0000","last_active":"2023-03-06T14:16:03.355117+0000","last_peered":"2023-03-06T14:16:03.355117+0000","last_clean":"2023-03-06T14:16:03.355117+0000","last_became_active":"2023-03-06T14:16:02.640221+0000","last_became_peered":"2023-03-06T14:16:02.640221+0000","last_unstale":"2023-03-06T14:16:03.355117+0000","last_undegraded":"2023-03-06T14:16:03.355117+0000","last_fullsized":"2023-03-06T14:16:03.355117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:27:58.703596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.632795+0000","last_change":"2023-03-06T14:15:58.198789+0000","last_active":"2023-03-06T14:16:02.632795+0000","last_peered":"2023-03-06T14:16:02.632795+0000","last_clean":"2023-03-06T14:16:02.632795+0000","last_became_active":"2023-03-06T14:15:58.197338+0000","last_became_peered":"2023-03-06T14:15:58.197338+0000","last_unstale":"2023-03-06T14:16:02.632795+0000","last_undegraded":"2023-03-06T14:16:02.632795+0000","last_fullsized":"2023-03-06T14:16:02.632795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:55:42.146253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620931+0000","last_change":"2023-03-06T14:15:58.626518+0000","last_active":"2023-03-06T14:16:02.620931+0000","last_peered":"2023-03-06T14:16:02.620931+0000","last_clean":"2023-03-06T14:16:02.620931+0000","last_became_active":"2023-03-06T14:15:58.626233+0000","last_became_peered":"2023-03-06T14:15:58.626233+0000","last_unstale":"2023-03-06T14:16:02.620931+0000","last_undegraded":"2023-03-06T14:16:02.620931+0000","last_fullsized":"2023-03-06T14:16:02.620931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:52:46.916668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291216+0000","last_change":"2023-03-06T14:16:02.650940+0000","last_active":"2023-03-06T14:16:03.291216+0000","last_peered":"2023-03-06T14:16:03.291216+0000","last_clean":"2023-03-06T14:16:03.291216+0000","last_became_active":"2023-03-06T14:16:02.650036+0000","last_became_peered":"2023-03-06T14:16:02.650036+0000","last_unstale":"2023-03-06T14:16:03.291216+0000","last_undegraded":"2023-03-06T14:16:03.291216+0000","last_fullsized":"2023-03-06T14:16:03.291216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:24:02.015602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631826+0000","last_change":"2023-03-06T14:15:58.197042+0000","last_active":"2023-03-06T14:16:02.631826+0000","last_peered":"2023-03-06T14:16:02.631826+0000","last_clean":"2023-03-06T14:16:02.631826+0000","last_became_active":"2023-03-06T14:15:58.196755+0000","last_became_peered":"2023-03-06T14:15:58.196755+0000","last_unstale":"2023-03-06T14:16:02.631826+0000","last_undegraded":"2023-03-06T14:16:02.631826+0000","last_fullsized":"2023-03-06T14:16:02.631826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:05.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622215+0000","last_change":"2023-03-06T14:15:58.624665+0000","last_active":"2023-03-06T14:16:02.622215+0000","last_peered":"2023-03-06T14:16:02.622215+0000","last_clean":"2023-03-06T14:16:02.622215+0000","last_became_active":"2023-03-06T14:15:58.624294+0000","last_became_peered":"2023-03-06T14:15:58.624294+0000","last_unstale":"2023-03-06T14:16:02.622215+0000","last_undegraded":"2023-03-06T14:16:02.622215+0000","last_fullsized":"2023-03-06T14:16:02.622215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:20:31.540353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291400+0000","last_change":"2023-03-06T14:16:02.652542+0000","last_active":"2023-03-06T14:16:03.291400+0000","last_peered":"2023-03-06T14:16:03.291400+0000","last_clean":"2023-03-06T14:16:03.291400+0000","last_became_active":"2023-03-06T14:16:02.652083+0000","last_became_peered":"2023-03-06T14:16:02.652083+0000","last_unstale":"2023-03-06T14:16:03.291400+0000","last_undegraded":"2023-03-06T14:16:03.291400+0000","last_fullsized":"2023-03-06T14:16:03.291400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:18:11.159923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.632018+0000","last_change":"2023-03-06T14:15:58.198266+0000","last_active":"2023-03-06T14:16:02.632018+0000","last_peered":"2023-03-06T14:16:02.632018+0000","last_clean":"2023-03-06T14:16:02.632018+0000","last_became_active":"2023-03-06T14:15:58.197982+0000","last_became_peered":"2023-03-06T14:15:58.197982+0000","last_unstale":"2023-03-06T14:16:02.632018+0000","last_undegraded":"2023-03-06T14:16:02.632018+0000","last_fullsized":"2023-03-06T14:16:02.632018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:35.375050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.627709+0000","last_change":"2023-03-06T14:15:58.626386+0000","last_active":"2023-03-06T14:16:02.627709+0000","last_peered":"2023-03-06T14:16:02.627709+0000","last_clean":"2023-03-06T14:16:02.627709+0000","last_became_active":"2023-03-06T14:15:58.626081+0000","last_became_peered":"2023-03-06T14:15:58.626081+0000","last_unstale":"2023-03-06T14:16:02.627709+0000","last_undegraded":"2023-03-06T14:16:02.627709+0000","last_fullsized":"2023-03-06T14:16:02.627709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:06.411673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291518+0000","last_change":"2023-03-06T14:16:02.645559+0000","last_active":"2023-03-06T14:16:03.291518+0000","last_peered":"2023-03-06T14:16:03.291518+0000","last_clean":"2023-03-06T14:16:03.291518+0000","last_became_active":"2023-03-06T14:16:02.645162+0000","last_became_peered":"2023-03-06T14:16:02.645162+0000","last_unstale":"2023-03-06T14:16:03.291518+0000","last_undegraded":"2023-03-06T14:16:03.291518+0000","last_fullsized":"2023-03-06T14:16:03.291518+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:41.452541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621160+0000","last_change":"2023-03-06T14:15:58.201356+0000","last_active":"2023-03-06T14:16:02.621160+0000","last_peered":"2023-03-06T14:16:02.621160+0000","last_clean":"2023-03-06T14:16:02.621160+0000","last_became_active":"2023-03-06T14:15:58.201039+0000","last_became_peered":"2023-03-06T14:15:58.201039+0000","last_unstale":"2023-03-06T14:16:02.621160+0000","last_undegraded":"2023-03-06T14:16:02.621160+0000","last_fullsized":"2023-03-06T14:16:02.621160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:30:50.230310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637140+0000","last_change":"2023-03-06T14:15:58.626686+0000","last_active":"2023-03-06T14:16:02.637140+0000","last_peered":"2023-03-06T14:16:02.637140+0000","last_clean":"2023-03-06T14:16:02.637140+0000","last_became_active":"2023-03-06T14:15:58.626389+0000","last_became_peered":"2023-03-06T14:15:58.626389+0000","last_unstale":"2023-03-06T14:16:02.637140+0000","last_undegraded":"2023-03-06T14:16:02.637140+0000","last_fullsized":"2023-03-06T14:16:02.637140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:20:31.540353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291620+0000","last_change":"2023-03-06T14:16:02.642347+0000","last_active":"2023-03-06T14:16:03.291620+0000","last_peered":"2023-03-06T14:16:03.291620+0000","last_clean":"2023-03-06T14:16:03.291620+0000","last_became_active":"2023-03-06T14:16:02.641731+0000","last_became_peered":"2023-03-06T14:16:02.641731+0000","last_unstale":"2023-03-06T14:16:03.291620+0000","last_undegraded":"2023-03-06T14:16:03.291620+0000","last_fullsized":"2023-03-06T14:16:03.291620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:44:38.354278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620347+0000","last_change":"2023-03-06T14:15:58.203350+0000","last_active":"2023-03-06T14:16:02.620347+0000","last_peered":"2023-03-06T14:16:02.620347+0000","last_clean":"2023-03-06T14:16:02.620347+0000","last_became_active":"2023-03-06T14:15:58.203061+0000","last_became_peered":"2023-03-06T14:15:58.203061+0000","last_unstale":"2023-03-06T14:16:02.620347+0000","last_undegraded":"2023-03-06T14:16:02.620347+0000","last_fullsized":"2023-03-06T14:16:02.620347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:51.640135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623485+0000","last_change":"2023-03-06T14:15:58.622192+0000","last_active":"2023-03-06T14:16:02.623485+0000","last_peered":"2023-03-06T14:16:02.623485+0000","last_clean":"2023-03-06T14:16:02.623485+0000","last_became_active":"2023-03-06T14:15:58.621902+0000","last_became_peered":"2023-03-06T14:15:58.621902+0000","last_unstale":"2023-03-06T14:16:02.623485+0000","last_undegraded":"2023-03-06T14:16:02.623485+0000","last_fullsized":"2023-03-06T14:16:02.623485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:44:34.915729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.155015+0000","last_change":"2023-03-06T14:16:02.646555+0000","last_active":"2023-03-06T14:16:03.155015+0000","last_peered":"2023-03-06T14:16:03.155015+0000","last_clean":"2023-03-06T14:16:03.155015+0000","last_became_active":"2023-03-06T14:16:02.646107+0000","last_became_peered":"2023-03-06T14:16:02.646107+0000","last_unstale":"2023-03-06T14:16:03.155015+0000","last_undegraded":"2023-03-06T14:16:03.155015+0000","last_fullsized":"2023-03-06T14:16:03.155015+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:07:43.686453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.627804+0000","last_change":"2023-03-06T14:15:58.190228+0000","last_active":"2023-03-06T14:16:02.627804+0000","last_peered":"2023-03-06T14:16:02.627804+0000","last_clean":"2023-03-06T14:16:02.627804+0000","last_became_active":"2023-03-06T14:15:58.189952+0000","last_became_peered":"2023-03-06T14:15:58.189952+0000","last_unstale":"2023-03-06T14:16:02.627804+0000","last_undegraded":"2023-03-06T14:16:02.627804+0000","last_fullsized":"2023-03-06T14:16:02.627804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:29:15.572837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.624802+0000","last_change":"2023-03-06T14:15:58.618284+0000","last_active":"2023-03-06T14:16:02.624802+0000","last_peered":"2023-03-06T14:16:02.624802+0000","last_clean":"2023-03-06T14:16:02.624802+0000","last_became_active":"2023-03-06T14:15:58.617886+0000","last_became_peered":"2023-03-06T14:15:58.617886+0000","last_unstale":"2023-03-06T14:16:02.624802+0000","last_undegraded":"2023-03-06T14:16:02.624802+0000","last_fullsized":"2023-03-06T14:16:02.624802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:10:40.167591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045610+0000","last_change":"2023-03-06T14:16:02.647040+0000","last_active":"2023-03-06T14:16:03.045610+0000","last_peered":"2023-03-06T14:16:03.045610+0000","last_clean":"2023-03-06T14:16:03.045610+0000","last_became_active":"2023-03-06T14:16:02.645423+0000","last_became_peered":"2023-03-06T14:16:02.645423+0000","last_unstale":"2023-03-06T14:16:03.045610+0000","last_undegraded":"2023-03-06T14:16:03.045610+0000","last_fullsized":"2023-03-06T14:16:03.045610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:13:57.742131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622031+0000","last_change":"2023-03-06T14:15:58.197730+0000","last_active":"2023-03-06T14:16:02.622031+0000","last_peered":"2023-03-06T14:16:02.622031+0000","last_clean":"2023-03-06T14:16:02.622031+0000","last_became_active":"2023-03-06T14:15:58.197400+0000","last_became_peered":"2023-03-06T14:15:58.197400+0000","last_unstale":"2023-03-06T14:16:02.622031+0000","last_undegraded":"2023-03-06T14:16:02.622031+0000","last_fullsized":"2023-03-06T14:16:02.622031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:56:39.417304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.625017+0000","last_change":"2023-03-06T14:15:58.615181+0000","last_active":"2023-03-06T14:16:02.625017+0000","last_peered":"2023-03-06T14:16:02.625017+0000","last_clean":"2023-03-06T14:16:02.625017+0000","last_became_active":"2023-03-06T14:15:58.614850+0000","last_became_peered":"2023-03-06T14:15:58.614850+0000","last_unstale":"2023-03-06T14:16:02.625017+0000","last_undegraded":"2023-03-06T14:16:02.625017+0000","last_fullsized":"2023-03-06T14:16:02.625017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.354671+0000","last_change":"2023-03-06T14:16:02.646047+0000","last_active":"2023-03-06T14:16:03.354671+0000","last_peered":"2023-03-06T14:16:03.354671+0000","last_clean":"2023-03-06T14:16:03.354671+0000","last_became_active":"2023-03-06T14:16:02.645633+0000","last_became_peered":"2023-03-06T14:16:02.645633+0000","last_unstale":"2023-03-06T14:16:03.354671+0000","last_undegraded":"2023-03-06T14:16:03.354671+0000","last_fullsized":"2023-03-06T14:16:03.354671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:50:22.369914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620211+0000","last_change":"2023-03-06T14:15:58.203072+0000","last_active":"2023-03-06T14:16:02.620211+0000","last_peered":"2023-03-06T14:16:02.620211+0000","last_clean":"2023-03-06T14:16:02.620211+0000","last_became_active":"2023-03-06T14:15:58.202762+0000","last_became_peered":"2023-03-06T14:15:58.202762+0000","last_unstale":"2023-03-06T14:16:02.620211+0000","last_undegraded":"2023-03-06T14:16:02.620211+0000","last_fullsized":"2023-03-06T14:16:02.620211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:01:51.926759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637882+0000","last_change":"2023-03-06T14:15:58.624080+0000","last_active":"2023-03-06T14:16:02.637882+0000","last_peered":"2023-03-06T14:16:02.637882+0000","last_clean":"2023-03-06T14:16:02.637882+0000","last_became_active":"2023-03-06T14:15:58.623721+0000","last_became_peered":"2023-03-06T14:15:58.623721+0000","last_unstale":"2023-03-06T14:16:02.637882+0000","last_undegraded":"2023-03-06T14:16:02.637882+0000","last_fullsized":"2023-03-06T14:16:02.637882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:52:46.916668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.152408+0000","last_change":"2023-03-06T14:16:02.653426+0000","last_active":"2023-03-06T14:16:03.152408+0000","last_peered":"2023-03-06T14:16:03.152408+0000","last_clean":"2023-03-06T14:16:03.152408+0000","last_became_active":"2023-03-06T14:16:02.653013+0000","last_became_peered":"2023-03-06T14:16:02.653013+0000","last_unstale":"2023-03-06T14:16:03.152408+0000","last_undegraded":"2023-03-06T14:16:03.152408+0000","last_fullsized":"2023-03-06T14:16:03.152408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:07:43.686453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637353+0000","last_change":"2023-03-06T14:15:53.577710+0000","last_active":"2023-03-06T14:16:02.637353+0000","last_peered":"2023-03-06T14:16:02.637353+0000","last_clean":"2023-03-06T14:16:02.637353+0000","last_became_active":"2023-03-06T14:15:53.577390+0000","last_became_peered":"2023-03-06T14:15:53.577390+0000","last_unstale":"2023-03-06T14:16:02.637353+0000","last_undegraded":"2023-03-06T14:16:02.637353+0000","last_fullsized":"2023-03-06T14:16:02.637353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:59:36.846415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623367+0000","last_change":"2023-03-06T14:15:58.201310+0000","last_active":"2023-03-06T14:16:02.623367+0000","last_peered":"2023-03-06T14:16:02.623367+0000","last_clean":"2023-03-06T14:16:02.623367+0000","last_became_active":"2023-03-06T14:15:58.200984+0000","last_became_peered":"2023-03-06T14:15:58.200984+0000","last_unstale":"2023-03-06T14:16:02.623367+0000","last_undegraded":"2023-03-06T14:16:02.623367+0000","last_fullsized":"2023-03-06T14:16:02.623367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:01:51.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637200+0000","last_change":"2023-03-06T14:15:58.624165+0000","last_active":"2023-03-06T14:16:02.637200+0000","last_peered":"2023-03-06T14:16:02.637200+0000","last_clean":"2023-03-06T14:16:02.637200+0000","last_became_active":"2023-03-06T14:15:58.623385+0000","last_became_peered":"2023-03-06T14:15:58.623385+0000","last_unstale":"2023-03-06T14:16:02.637200+0000","last_undegraded":"2023-03-06T14:16:02.637200+0000","last_fullsized":"2023-03-06T14:16:02.637200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:48:05.347666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.152390+0000","last_change":"2023-03-06T14:16:02.648398+0000","last_active":"2023-03-06T14:16:03.152390+0000","last_peered":"2023-03-06T14:16:03.152390+0000","last_clean":"2023-03-06T14:16:03.152390+0000","last_became_active":"2023-03-06T14:16:02.647065+0000","last_became_peered":"2023-03-06T14:16:02.647065+0000","last_unstale":"2023-03-06T14:16:03.152390+0000","last_undegraded":"2023-03-06T14:16:03.152390+0000","last_fullsized":"2023-03-06T14:16:03.152390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:07:17.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620733+0000","last_change":"2023-03-06T14:15:53.036374+0000","last_active":"2023-03-06T14:16:02.620733+0000","last_peered":"2023-03-06T14:16:02.620733+0000","last_clean":"2023-03-06T14:16:02.620733+0000","last_became_active":"2023-03-06T14:15:53.036038+0000","last_became_peered":"2023-03-06T14:15:53.036038+0000","last_unstale":"2023-03-06T14:16:02.620733+0000","last_undegraded":"2023-03-06T14:16:02.620733+0000","last_fullsized":"2023-03-06T14:16:02.620733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:59:36.846415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623310+0000","last_change":"2023-03-06T14:15:58.205953+0000","last_active":"2023-03-06T14:16:02.623310+0000","last_peered":"2023-03-06T14:16:02.623310+0000","last_clean":"2023-03-06T14:16:02.623310+0000","last_became_active":"2023-03-06T14:15:58.205660+0000","last_became_peered":"2023-03-06T14:15:58.205660+0000","last_unstale":"2023-03-06T14:16:02.623310+0000","last_undegraded":"2023-03-06T14:16:02.623310+0000","last_fullsized":"2023-03-06T14:16:02.623310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:01:51.926759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637265+0000","last_change":"2023-03-06T14:15:58.623348+0000","last_active":"2023-03-06T14:16:02.637265+0000","last_peered":"2023-03-06T14:16:02.637265+0000","last_clean":"2023-03-06T14:16:02.637265+0000","last_became_active":"2023-03-06T14:15:58.622915+0000","last_became_peered":"2023-03-06T14:15:58.622915+0000","last_unstale":"2023-03-06T14:16:02.637265+0000","last_undegraded":"2023-03-06T14:16:02.637265+0000","last_fullsized":"2023-03-06T14:16:02.637265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291678+0000","last_change":"2023-03-06T14:16:02.651042+0000","last_active":"2023-03-06T14:16:03.291678+0000","last_peered":"2023-03-06T14:16:03.291678+0000","last_clean":"2023-03-06T14:16:03.291678+0000","last_became_active":"2023-03-06T14:16:02.650162+0000","last_became_peered":"2023-03-06T14:16:02.650162+0000","last_unstale":"2023-03-06T14:16:03.291678+0000","last_undegraded":"2023-03-06T14:16:03.291678+0000","last_fullsized":"2023-03-06T14:16:03.291678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:37:28.905994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.634164+0000","last_change":"2023-03-06T14:15:53.036522+0000","last_active":"2023-03-06T14:16:02.634164+0000","last_peered":"2023-03-06T14:16:02.634164+0000","last_clean":"2023-03-06T14:16:02.634164+0000","last_became_active":"2023-03-06T14:15:53.036163+0000","last_became_peered":"2023-03-06T14:15:53.036163+0000","last_unstale":"2023-03-06T14:16:02.634164+0000","last_undegraded":"2023-03-06T14:16:02.634164+0000","last_fullsized":"2023-03-06T14:16:02.634164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:27:14.056008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.635952+0000","last_change":"2023-03-06T14:15:58.197803+0000","last_active":"2023-03-06T14:16:02.635952+0000","last_peered":"2023-03-06T14:16:02.635952+0000","last_clean":"2023-03-06T14:16:02.635952+0000","last_became_active":"2023-03-06T14:15:58.197545+0000","last_became_peered":"2023-03-06T14:15:58.197545+0000","last_unstale":"2023-03-06T14:16:02.635952+0000","last_undegraded":"2023-03-06T14:16:02.635952+0000","last_fullsized":"2023-03-06T14:16:02.635952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:12:34.886024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637845+0000","last_change":"2023-03-06T14:15:58.623911+0000","last_active":"2023-03-06T14:16:02.637845+0000","last_peered":"2023-03-06T14:16:02.637845+0000","last_clean":"2023-03-06T14:16:02.637845+0000","last_became_active":"2023-03-06T14:15:58.623425+0000","last_became_peered":"2023-03-06T14:15:58.623425+0000","last_unstale":"2023-03-06T14:16:02.637845+0000","last_undegraded":"2023-03-06T14:16:02.637845+0000","last_fullsized":"2023-03-06T14:16:02.637845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:25:29.813558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.355462+0000","last_change":"2023-03-06T14:16:02.651414+0000","last_active":"2023-03-06T14:16:03.355462+0000","last_peered":"2023-03-06T14:16:03.355462+0000","last_clean":"2023-03-06T14:16:03.355462+0000","last_became_active":"2023-03-06T14:16:02.650987+0000","last_became_peered":"2023-03-06T14:16:02.650987+0000","last_unstale":"2023-03-06T14:16:03.355462+0000","last_undegraded":"2023-03-06T14:16:03.355462+0000","last_fullsized":"2023-03-06T14:16:03.355462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:07:17.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621937+0000","last_change":"2023-03-06T14:15:53.036219+0000","last_active":"2023-03-06T14:16:02.621937+0000","last_peered":"2023-03-06T14:16:02.621937+0000","last_clean":"2023-03-06T14:16:02.621937+0000","last_became_active":"2023-03-06T14:15:53.035884+0000","last_became_peered":"2023-03-06T14:15:53.035884+0000","last_unstale":"2023-03-06T14:16:02.621937+0000","last_undegraded":"2023-03-06T14:16:02.621937+0000","last_fullsized":"2023-03-06T14:16:02.621937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:08:35.979345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":171,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.630995+0000","last_change":"2023-03-06T14:15:46.468596+0000","last_active":"2023-03-06T14:16:02.630995+0000","last_peered":"2023-03-06T14:16:02.630995+0000","last_clean":"2023-03-06T14:16:02.630995+0000","last_became_active":"2023-03-06T14:15:46.467792+0000","last_became_peered":"2023-03-06T14:15:46.467792+0000","last_unstale":"2023-03-06T14:16:02.630995+0000","last_undegraded":"2023-03-06T14:16:02.630995+0000","last_fullsized":"2023-03-06T14:16:02.630995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:45.376343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:45.376343+0000","last_clean_scrub_stamp":"2023-03-06T14:15:45.376343+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:52:08.690494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620179+0000","last_change":"2023-03-06T14:15:58.193624+0000","last_active":"2023-03-06T14:16:02.620179+0000","last_peered":"2023-03-06T14:16:02.620179+0000","last_clean":"2023-03-06T14:16:02.620179+0000","last_became_active":"2023-03-06T14:15:58.192670+0000","last_became_peered":"2023-03-06T14:15:58.192670+0000","last_unstale":"2023-03-06T14:16:02.620179+0000","last_undegraded":"2023-03-06T14:16:02.620179+0000","last_fullsized":"2023-03-06T14:16:02.620179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:56:39.417304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628029+0000","last_change":"2023-03-06T14:15:58.621410+0000","last_active":"2023-03-06T14:16:02.628029+0000","last_peered":"2023-03-06T14:16:02.628029+0000","last_clean":"2023-03-06T14:16:02.628029+0000","last_became_active":"2023-03-06T14:15:58.621119+0000","last_became_peered":"2023-03-06T14:15:58.621119+0000","last_unstale":"2023-03-06T14:16:02.628029+0000","last_undegraded":"2023-03-06T14:16:02.628029+0000","last_fullsized":"2023-03-06T14:16:02.628029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:07:29.725804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045514+0000","last_change":"2023-03-06T14:16:02.647842+0000","last_active":"2023-03-06T14:16:03.045514+0000","last_peered":"2023-03-06T14:16:03.045514+0000","last_clean":"2023-03-06T14:16:03.045514+0000","last_became_active":"2023-03-06T14:16:02.647453+0000","last_became_peered":"2023-03-06T14:16:02.647453+0000","last_unstale":"2023-03-06T14:16:03.045514+0000","last_undegraded":"2023-03-06T14:16:03.045514+0000","last_fullsized":"2023-03-06T14:16:03.045514+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:16:47.318848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631088+0000","last_change":"2023-03-06T14:15:53.037318+0000","last_active":"2023-03-06T14:16:02.631088+0000","last_peered":"2023-03-06T14:16:02.631088+0000","last_clean":"2023-03-06T14:16:02.631088+0000","last_became_active":"2023-03-06T14:15:53.036984+0000","last_became_peered":"2023-03-06T14:15:53.036984+0000","last_unstale":"2023-03-06T14:16:02.631088+0000","last_undegraded":"2023-03-06T14:16:02.631088+0000","last_fullsized":"2023-03-06T14:16:02.631088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:59:36.846415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633034+0000","last_change":"2023-03-06T14:15:58.203061+0000","last_active":"2023-03-06T14:16:02.633034+0000","last_peered":"2023-03-06T14:16:02.633034+0000","last_clean":"2023-03-06T14:16:02.633034+0000","last_became_active":"2023-03-06T14:15:58.202734+0000","last_became_peered":"2023-03-06T14:15:58.202734+0000","last_unstale":"2023-03-06T14:16:02.633034+0000","last_undegraded":"2023-03-06T14:16:02.633034+0000","last_fullsized":"2023-03-06T14:16:02.633034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:56:39.417304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631131+0000","last_change":"2023-03-06T14:15:58.628462+0000","last_active":"2023-03-06T14:16:02.631131+0000","last_peered":"2023-03-06T14:16:02.631131+0000","last_clean":"2023-03-06T14:16:02.631131+0000","last_became_active":"2023-03-06T14:15:58.628169+0000","last_became_peered":"2023-03-06T14:15:58.628169+0000","last_unstale":"2023-03-06T14:16:02.631131+0000","last_undegraded":"2023-03-06T14:16:02.631131+0000","last_fullsized":"2023-03-06T14:16:02.631131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:11:35.054920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046549+0000","last_change":"2023-03-06T14:16:02.651316+0000","last_active":"2023-03-06T14:16:03.046549+0000","last_peered":"2023-03-06T14:16:03.046549+0000","last_clean":"2023-03-06T14:16:03.046549+0000","last_became_active":"2023-03-06T14:16:02.650952+0000","last_became_peered":"2023-03-06T14:16:02.650952+0000","last_unstale":"2023-03-06T14:16:03.046549+0000","last_undegraded":"2023-03-06T14:16:03.046549+0000","last_fullsized":"2023-03-06T14:16:03.046549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:10:43.606141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631980+0000","last_change":"2023-03-06T14:15:53.577586+0000","last_active":"2023-03-06T14:16:02.631980+0000","last_peered":"2023-03-06T14:16:02.631980+0000","last_clean":"2023-03-06T14:16:02.631980+0000","last_became_active":"2023-03-06T14:15:53.577345+0000","last_became_peered":"2023-03-06T14:15:53.577345+0000","last_unstale":"2023-03-06T14:16:02.631980+0000","last_undegraded":"2023-03-06T14:16:02.631980+0000","last_fullsized":"2023-03-06T14:16:02.631980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:08:35.979345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637442+0000","last_change":"2023-03-06T14:15:58.199583+0000","last_active":"2023-03-06T14:16:02.637442+0000","last_peered":"2023-03-06T14:16:02.637442+0000","last_clean":"2023-03-06T14:16:02.637442+0000","last_became_active":"2023-03-06T14:15:58.199288+0000","last_became_peered":"2023-03-06T14:15:58.199288+0000","last_unstale":"2023-03-06T14:16:02.637442+0000","last_undegraded":"2023-03-06T14:16:02.637442+0000","last_fullsized":"2023-03-06T14:16:02.637442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:51.640135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.636887+0000","last_change":"2023-03-06T14:15:58.623642+0000","last_active":"2023-03-06T14:16:02.636887+0000","last_peered":"2023-03-06T14:16:02.636887+0000","last_clean":"2023-03-06T14:16:02.636887+0000","last_became_active":"2023-03-06T14:15:58.623387+0000","last_became_peered":"2023-03-06T14:15:58.623387+0000","last_unstale":"2023-03-06T14:16:02.636887+0000","last_undegraded":"2023-03-06T14:16:02.636887+0000","last_fullsized":"2023-03-06T14:16:02.636887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.355184+0000","last_change":"2023-03-06T14:16:02.639772+0000","last_active":"2023-03-06T14:16:03.355184+0000","last_peered":"2023-03-06T14:16:03.355184+0000","last_clean":"2023-03-06T14:16:03.355184+0000","last_became_active":"2023-03-06T14:16:02.639392+0000","last_became_peered":"2023-03-06T14:16:02.639392+0000","last_unstale":"2023-03-06T14:16:03.355184+0000","last_undegraded":"2023-03-06T14:16:03.355184+0000","last_fullsized":"2023-03-06T14:16:03.355184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:24:14.685213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620927+0000","last_change":"2023-03-06T14:15:58.196943+0000","last_active":"2023-03-06T14:16:02.620927+0000","last_peered":"2023-03-06T14:16:02.620927+0000","last_clean":"2023-03-06T14:16:02.620927+0000","last_became_active":"2023-03-06T14:15:58.196688+0000","last_became_peered":"2023-03-06T14:15:58.196688+0000","last_unstale":"2023-03-06T14:16:02.620927+0000","last_undegraded":"2023-03-06T14:16:02.620927+0000","last_fullsized":"2023-03-06T14:16:02.620927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:12:34.886024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637450+0000","last_change":"2023-03-06T14:15:53.040061+0000","last_active":"2023-03-06T14:16:02.637450+0000","last_peered":"2023-03-06T14:16:02.637450+0000","last_clean":"2023-03-06T14:16:02.637450+0000","last_became_active":"2023-03-06T14:15:53.039743+0000","last_became_peered":"2023-03-06T14:15:53.039743+0000","last_unstale":"2023-03-06T14:16:02.637450+0000","last_undegraded":"2023-03-06T14:16:02.637450+0000","last_fullsized":"2023-03-06T14:16:02.637450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:08:35.979345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620100+0000","last_change":"2023-03-06T14:15:58.630844+0000","last_active":"2023-03-06T14:16:02.620100+0000","last_peered":"2023-03-06T14:16:02.620100+0000","last_clean":"2023-03-06T14:16:02.620100+0000","last_became_active":"2023-03-06T14:15:58.630559+0000","last_became_peered":"2023-03-06T14:15:58.630559+0000","last_unstale":"2023-03-06T14:16:02.620100+0000","last_undegraded":"2023-03-06T14:16:02.620100+0000","last_fullsized":"2023-03-06T14:16:02.620100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046029+0000","last_change":"2023-03-06T14:16:02.642401+0000","last_active":"2023-03-06T14:16:03.046029+0000","last_peered":"2023-03-06T14:16:03.046029+0000","last_clean":"2023-03-06T14:16:03.046029+0000","last_became_active":"2023-03-06T14:16:02.641989+0000","last_became_peered":"2023-03-06T14:16:02.641989+0000","last_unstale":"2023-03-06T14:16:03.046029+0000","last_undegraded":"2023-03-06T14:16:03.046029+0000","last_fullsized":"2023-03-06T14:16:03.046029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:36:04.845196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628635+0000","last_change":"2023-03-06T14:15:53.037412+0000","last_active":"2023-03-06T14:16:02.628635+0000","last_peered":"2023-03-06T14:16:02.628635+0000","last_clean":"2023-03-06T14:16:02.628635+0000","last_became_active":"2023-03-06T14:15:53.037136+0000","last_became_peered":"2023-03-06T14:15:53.037136+0000","last_unstale":"2023-03-06T14:16:02.628635+0000","last_undegraded":"2023-03-06T14:16:02.628635+0000","last_fullsized":"2023-03-06T14:16:02.628635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:27:14.056008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.152637+0000","last_change":"2023-03-06T14:15:58.204500+0000","last_active":"2023-03-06T14:16:03.152637+0000","last_peered":"2023-03-06T14:16:03.152637+0000","last_clean":"2023-03-06T14:16:03.152637+0000","last_became_active":"2023-03-06T14:15:58.204199+0000","last_became_peered":"2023-03-06T14:15:58.204199+0000","last_unstale":"2023-03-06T14:16:03.152637+0000","last_undegraded":"2023-03-06T14:16:03.152637+0000","last_fullsized":"2023-03-06T14:16:03.152637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:35.375050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622127+0000","last_change":"2023-03-06T14:15:58.619009+0000","last_active":"2023-03-06T14:16:02.622127+0000","last_peered":"2023-03-06T14:16:02.622127+0000","last_clean":"2023-03-06T14:16:02.622127+0000","last_became_active":"2023-03-06T14:15:58.618684+0000","last_became_peered":"2023-03-06T14:15:58.618684+0000","last_unstale":"2023-03-06T14:16:02.622127+0000","last_undegraded":"2023-03-06T14:16:02.622127+0000","last_fullsized":"2023-03-06T14:16:02.622127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:23:58.577053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.155165+0000","last_change":"2023-03-06T14:16:02.648262+0000","last_active":"2023-03-06T14:16:03.155165+0000","last_peered":"2023-03-06T14:16:03.155165+0000","last_clean":"2023-03-06T14:16:03.155165+0000","last_became_active":"2023-03-06T14:16:02.647613+0000","last_became_peered":"2023-03-06T14:16:02.647613+0000","last_unstale":"2023-03-06T14:16:03.155165+0000","last_undegraded":"2023-03-06T14:16:03.155165+0000","last_fullsized":"2023-03-06T14:16:03.155165+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:14:39.393308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.636987+0000","last_change":"2023-03-06T14:15:58.199468+0000","last_active":"2023-03-06T14:16:02.636987+0000","last_peered":"2023-03-06T14:16:02.636987+0000","last_clean":"2023-03-06T14:16:02.636987+0000","last_became_active":"2023-03-06T14:15:58.199198+0000","last_became_peered":"2023-03-06T14:15:58.199198+0000","last_unstale":"2023-03-06T14:16:02.636987+0000","last_undegraded":"2023-03-06T14:16:02.636987+0000","last_fullsized":"2023-03-06T14:16:02.636987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:12:34.886024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.634082+0000","last_change":"2023-03-06T14:15:58.625329+0000","last_active":"2023-03-06T14:16:02.634082+0000","last_peered":"2023-03-06T14:16:02.634082+0000","last_clean":"2023-03-06T14:16:02.634082+0000","last_became_active":"2023-03-06T14:15:58.624965+0000","last_became_peered":"2023-03-06T14:15:58.624965+0000","last_unstale":"2023-03-06T14:16:02.634082+0000","last_undegraded":"2023-03-06T14:16:02.634082+0000","last_fullsized":"2023-03-06T14:16:02.634082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:42:03.424567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.354710+0000","last_change":"2023-03-06T14:16:02.647113+0000","last_active":"2023-03-06T14:16:03.354710+0000","last_peered":"2023-03-06T14:16:03.354710+0000","last_clean":"2023-03-06T14:16:03.354710+0000","last_became_active":"2023-03-06T14:16:02.646705+0000","last_became_peered":"2023-03-06T14:16:02.646705+0000","last_unstale":"2023-03-06T14:16:03.354710+0000","last_undegraded":"2023-03-06T14:16:03.354710+0000","last_fullsized":"2023-03-06T14:16:03.354710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:05.636662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621259+0000","last_change":"2023-03-06T14:15:58.196567+0000","last_active":"2023-03-06T14:16:02.621259+0000","last_peered":"2023-03-06T14:16:02.621259+0000","last_clean":"2023-03-06T14:16:02.621259+0000","last_became_active":"2023-03-06T14:15:58.196276+0000","last_became_peered":"2023-03-06T14:15:58.196276+0000","last_unstale":"2023-03-06T14:16:02.621259+0000","last_undegraded":"2023-03-06T14:16:02.621259+0000","last_fullsized":"2023-03-06T14:16:02.621259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:12:34.886024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623223+0000","last_change":"2023-03-06T14:15:58.618271+0000","last_active":"2023-03-06T14:16:02.623223+0000","last_peered":"2023-03-06T14:16:02.623223+0000","last_clean":"2023-03-06T14:16:02.623223+0000","last_became_active":"2023-03-06T14:15:58.617970+0000","last_became_peered":"2023-03-06T14:15:58.617970+0000","last_unstale":"2023-03-06T14:16:02.623223+0000","last_undegraded":"2023-03-06T14:16:02.623223+0000","last_fullsized":"2023-03-06T14:16:02.623223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:11:46.673965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045161+0000","last_change":"2023-03-06T14:16:02.652165+0000","last_active":"2023-03-06T14:16:03.045161+0000","last_peered":"2023-03-06T14:16:03.045161+0000","last_clean":"2023-03-06T14:16:03.045161+0000","last_became_active":"2023-03-06T14:16:02.651741+0000","last_became_peered":"2023-03-06T14:16:02.651741+0000","last_unstale":"2023-03-06T14:16:03.045161+0000","last_undegraded":"2023-03-06T14:16:03.045161+0000","last_fullsized":"2023-03-06T14:16:03.045161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:12:39.833476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623717+0000","last_change":"2023-03-06T14:15:58.197225+0000","last_active":"2023-03-06T14:16:02.623717+0000","last_peered":"2023-03-06T14:16:02.623717+0000","last_clean":"2023-03-06T14:16:02.623717+0000","last_became_active":"2023-03-06T14:15:58.196965+0000","last_became_peered":"2023-03-06T14:15:58.196965+0000","last_unstale":"2023-03-06T14:16:02.623717+0000","last_undegraded":"2023-03-06T14:16:02.623717+0000","last_fullsized":"2023-03-06T14:16:02.623717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:51.640135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623522+0000","last_change":"2023-03-06T14:15:58.618773+0000","last_active":"2023-03-06T14:16:02.623522+0000","last_peered":"2023-03-06T14:16:02.623522+0000","last_clean":"2023-03-06T14:16:02.623522+0000","last_became_active":"2023-03-06T14:15:58.618462+0000","last_became_peered":"2023-03-06T14:15:58.618462+0000","last_unstale":"2023-03-06T14:16:02.623522+0000","last_undegraded":"2023-03-06T14:16:02.623522+0000","last_fullsized":"2023-03-06T14:16:02.623522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:21:50.272173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.353835+0000","last_change":"2023-03-06T14:16:02.646882+0000","last_active":"2023-03-06T14:16:03.353835+0000","last_peered":"2023-03-06T14:16:03.353835+0000","last_clean":"2023-03-06T14:16:03.353835+0000","last_became_active":"2023-03-06T14:16:02.645688+0000","last_became_peered":"2023-03-06T14:16:02.645688+0000","last_unstale":"2023-03-06T14:16:03.353835+0000","last_undegraded":"2023-03-06T14:16:03.353835+0000","last_fullsized":"2023-03-06T14:16:03.353835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:28:49.627966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621195+0000","last_change":"2023-03-06T14:15:58.193377+0000","last_active":"2023-03-06T14:16:02.621195+0000","last_peered":"2023-03-06T14:16:02.621195+0000","last_clean":"2023-03-06T14:16:02.621195+0000","last_became_active":"2023-03-06T14:15:58.192974+0000","last_became_peered":"2023-03-06T14:15:58.192974+0000","last_unstale":"2023-03-06T14:16:02.621195+0000","last_undegraded":"2023-03-06T14:16:02.621195+0000","last_fullsized":"2023-03-06T14:16:02.621195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:35.375050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620221+0000","last_change":"2023-03-06T14:15:58.619235+0000","last_active":"2023-03-06T14:16:02.620221+0000","last_peered":"2023-03-06T14:16:02.620221+0000","last_clean":"2023-03-06T14:16:02.620221+0000","last_became_active":"2023-03-06T14:15:58.618729+0000","last_became_peered":"2023-03-06T14:15:58.618729+0000","last_unstale":"2023-03-06T14:16:02.620221+0000","last_undegraded":"2023-03-06T14:16:02.620221+0000","last_fullsized":"2023-03-06T14:16:02.620221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:21:50.272173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.155032+0000","last_change":"2023-03-06T14:16:02.643512+0000","last_active":"2023-03-06T14:16:03.155032+0000","last_peered":"2023-03-06T14:16:03.155032+0000","last_clean":"2023-03-06T14:16:03.155032+0000","last_became_active":"2023-03-06T14:16:02.643055+0000","last_became_peered":"2023-03-06T14:16:02.643055+0000","last_unstale":"2023-03-06T14:16:03.155032+0000","last_undegraded":"2023-03-06T14:16:03.155032+0000","last_fullsized":"2023-03-06T14:16:03.155032+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:07:17.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633951+0000","last_change":"2023-03-06T14:15:58.197748+0000","last_active":"2023-03-06T14:16:02.633951+0000","last_peered":"2023-03-06T14:16:02.633951+0000","last_clean":"2023-03-06T14:16:02.633951+0000","last_became_active":"2023-03-06T14:15:58.197244+0000","last_became_peered":"2023-03-06T14:15:58.197244+0000","last_unstale":"2023-03-06T14:16:02.633951+0000","last_undegraded":"2023-03-06T14:16:02.633951+0000","last_fullsized":"2023-03-06T14:16:02.633951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:01:51.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621581+0000","last_change":"2023-03-06T14:15:58.618371+0000","last_active":"2023-03-06T14:16:02.621581+0000","last_peered":"2023-03-06T14:16:02.621581+0000","last_clean":"2023-03-06T14:16:02.621581+0000","last_became_active":"2023-03-06T14:15:58.617809+0000","last_became_peered":"2023-03-06T14:15:58.617809+0000","last_unstale":"2023-03-06T14:16:02.621581+0000","last_undegraded":"2023-03-06T14:16:02.621581+0000","last_fullsized":"2023-03-06T14:16:02.621581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:38.013992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628414+0000","last_change":"2023-03-06T14:15:58.623731+0000","last_active":"2023-03-06T14:16:02.628414+0000","last_peered":"2023-03-06T14:16:02.628414+0000","last_clean":"2023-03-06T14:16:02.628414+0000","last_became_active":"2023-03-06T14:15:58.622566+0000","last_became_peered":"2023-03-06T14:15:58.622566+0000","last_unstale":"2023-03-06T14:16:02.628414+0000","last_undegraded":"2023-03-06T14:16:02.628414+0000","last_fullsized":"2023-03-06T14:16:02.628414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:42:03.424567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620436+0000","last_change":"2023-03-06T14:15:58.625127+0000","last_active":"2023-03-06T14:16:02.620436+0000","last_peered":"2023-03-06T14:16:02.620436+0000","last_clean":"2023-03-06T14:16:02.620436+0000","last_became_active":"2023-03-06T14:15:58.624835+0000","last_became_peered":"2023-03-06T14:15:58.624835+0000","last_unstale":"2023-03-06T14:16:02.620436+0000","last_undegraded":"2023-03-06T14:16:02.620436+0000","last_fullsized":"2023-03-06T14:16:02.620436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:20:31.540353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623660+0000","last_change":"2023-03-06T14:15:58.619829+0000","last_active":"2023-03-06T14:16:02.623660+0000","last_peered":"2023-03-06T14:16:02.623660+0000","last_clean":"2023-03-06T14:16:02.623660+0000","last_became_active":"2023-03-06T14:15:58.618933+0000","last_became_peered":"2023-03-06T14:15:58.618933+0000","last_unstale":"2023-03-06T14:16:02.623660+0000","last_undegraded":"2023-03-06T14:16:02.623660+0000","last_fullsized":"2023-03-06T14:16:02.623660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:37:30.914574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620448+0000","last_change":"2023-03-06T14:15:58.630339+0000","last_active":"2023-03-06T14:16:02.620448+0000","last_peered":"2023-03-06T14:16:02.620448+0000","last_clean":"2023-03-06T14:16:02.620448+0000","last_became_active":"2023-03-06T14:15:58.630079+0000","last_became_peered":"2023-03-06T14:15:58.630079+0000","last_unstale":"2023-03-06T14:16:02.620448+0000","last_undegraded":"2023-03-06T14:16:02.620448+0000","last_fullsized":"2023-03-06T14:16:02.620448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:37:30.914574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637592+0000","last_change":"2023-03-06T14:15:58.632453+0000","last_active":"2023-03-06T14:16:02.637592+0000","last_peered":"2023-03-06T14:16:02.637592+0000","last_clean":"2023-03-06T14:16:02.637592+0000","last_became_active":"2023-03-06T14:15:58.632051+0000","last_became_peered":"2023-03-06T14:15:58.632051+0000","last_unstale":"2023-03-06T14:16:02.637592+0000","last_undegraded":"2023-03-06T14:16:02.637592+0000","last_fullsized":"2023-03-06T14:16:02.637592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4528,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9284,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362556,"statfs":{"total":96636764160,"available":96627257344,"internally_reserved":0,"allocated":913408,"data_stored":714090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8164,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363676,"statfs":{"total":96636764160,"available":96628404224,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9260,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362580,"statfs":{"total":96636764160,"available":96627281920,"internally_reserved":0,"allocated":888832,"data_stored":710835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8248,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363592,"statfs":{"total":96636764160,"available":96628318208,"internally_reserved":0,"allocated":311296,"data_stored":123703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8172,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363668,"statfs":{"total":96636764160,"available":96628396032,"internally_reserved":0,"allocated":299008,"data_stored":120537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-06T14:16:18.692 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-03-06T14:16:18.693 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-03-06T14:16:18.693 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-03-06T14:16:18.693 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-03-06T14:16:18.694 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-03-06T14:16:18.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.847+0000 7f47a3c16700 1 Processor -- start 2023-03-06T14:16:18.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.847+0000 7f47a3c16700 1 -- start start 2023-03-06T14:16:18.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.847+0000 7f47a3c16700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f479c0b77d0 0x7f479c14fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:18.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.848+0000 7f47a3c16700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f479c0b7ba0 0x7f479c152f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:18.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.848+0000 7f47a3c16700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c152aa0 con 0x7f479c148c10 2023-03-06T14:16:18.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.848+0000 7f47a3c16700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c14ffd0 con 0x7f479c0b77d0 2023-03-06T14:16:18.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.848+0000 7f47a3c16700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c06f720 con 0x7f479c0b7ba0 2023-03-06T14:16:18.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.848+0000 7f47a19b2700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f479c0b77d0 0x7f479c14fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:18.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.848+0000 7f47a19b2700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f479c0b77d0 0x7f479c14fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56036/0 (socket says 172.21.15.3:56036) 2023-03-06T14:16:18.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.848+0000 7f47a19b2700 1 -- 172.21.15.3:0/3613789658 learned_addr learned my addr 172.21.15.3:0/3613789658 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:18.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.848+0000 7f47a11b1700 1 --2- 172.21.15.3:0/3613789658 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f479c0b7ba0 0x7f479c152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:18.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.848+0000 7f47a19b2700 1 -- 172.21.15.3:0/3613789658 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f479c0b7ba0 msgr2=0x7f479c152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:18.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.848+0000 7f47a19b2700 1 --2- 172.21.15.3:0/3613789658 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f479c0b7ba0 0x7f479c152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.848+0000 7f47a19b2700 1 -- 172.21.15.3:0/3613789658 >> v1:172.21.15.136:6789/0 conn(0x7f479c148c10 legacy=0x7f479c06def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:18.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.848+0000 7f47a19b2700 1 -- 172.21.15.3:0/3613789658 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c06f160 con 0x7f479c0b77d0 2023-03-06T14:16:18.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.848+0000 7f47a19b2700 1 --2- 172.21.15.3:0/3613789658 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c0b77d0 0x7f479c14fa90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f47980098f0 tx=0x7f4798009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbfa4da40c390ee server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:18.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.848+0000 7f47a09b0700 1 -- 172.21.15.3:0/3613789658 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798004230 con 0x7f479c0b77d0 2023-03-06T14:16:18.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.848+0000 7f47a09b0700 1 -- 172.21.15.3:0/3613789658 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4798004390 con 0x7f479c0b77d0 2023-03-06T14:16:18.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.848+0000 7f47a09b0700 1 -- 172.21.15.3:0/3613789658 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47980036a0 con 0x7f479c0b77d0 2023-03-06T14:16:18.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.849+0000 7f47a3c16700 1 -- 172.21.15.3:0/3613789658 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c0b77d0 msgr2=0x7f479c14fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:18.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.849+0000 7f47a3c16700 1 --2- 172.21.15.3:0/3613789658 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c0b77d0 0x7f479c14fa90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f47980098f0 tx=0x7f4798009c00 comp rx=0 tx=0).stop 2023-03-06T14:16:18.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.849+0000 7f47a3c16700 1 -- 172.21.15.3:0/3613789658 shutdown_connections 2023-03-06T14:16:18.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.849+0000 7f47a3c16700 1 --2- 172.21.15.3:0/3613789658 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c0b77d0 0x7f479c14fa90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.849+0000 7f47a3c16700 1 --2- 172.21.15.3:0/3613789658 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f479c0b7ba0 0x7f479c152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.849+0000 7f47a3c16700 1 -- 172.21.15.3:0/3613789658 >> 172.21.15.3:0/3613789658 conn(0x7f479c0c17d0 msgr2=0x7f479c0c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:18.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.849+0000 7f47a3c16700 1 -- 172.21.15.3:0/3613789658 shutdown_connections 2023-03-06T14:16:18.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.849+0000 7f47a3c16700 1 -- 172.21.15.3:0/3613789658 wait complete. 2023-03-06T14:16:18.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.851+0000 7f47a3c16700 1 Processor -- start 2023-03-06T14:16:18.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.851+0000 7f47a3c16700 1 -- start start 2023-03-06T14:16:18.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.851+0000 7f47a3c16700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f479c0b77d0 0x7f479c0bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:18.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.851+0000 7f47a3c16700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f479c0b7ba0 0x7f479c151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:18.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.851+0000 7f47a3c16700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c148c10 0x7f479c143b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:18.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.851+0000 7f47a3c16700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c152180 con 0x7f479c148c10 2023-03-06T14:16:18.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.851+0000 7f47a3c16700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c146740 con 0x7f479c0b7ba0 2023-03-06T14:16:18.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.851+0000 7f47a3c16700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c146180 con 0x7f479c0b77d0 2023-03-06T14:16:18.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.852+0000 7f47a21b3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c148c10 0x7f479c143b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:18.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.852+0000 7f47a21b3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c148c10 0x7f479c143b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56046/0 (socket says 172.21.15.3:56046) 2023-03-06T14:16:18.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.852+0000 7f47a21b3700 1 -- 172.21.15.3:0/3047687137 learned_addr learned my addr 172.21.15.3:0/3047687137 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:18.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.852+0000 7f47a19b2700 1 --2- 172.21.15.3:0/3047687137 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f479c0b77d0 0x7f479c0bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:18.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.852+0000 7f47a11b1700 1 --2- 172.21.15.3:0/3047687137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f479c0b7ba0 0x7f479c151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:18.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.852+0000 7f47a21b3700 1 -- 172.21.15.3:0/3047687137 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f479c0b77d0 msgr2=0x7f479c0bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:18.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.852+0000 7f47a21b3700 1 --2- 172.21.15.3:0/3047687137 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f479c0b77d0 0x7f479c0bfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.852+0000 7f47a21b3700 1 -- 172.21.15.3:0/3047687137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f479c0b7ba0 msgr2=0x7f479c151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:18.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.852+0000 7f47a21b3700 1 --2- 172.21.15.3:0/3047687137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f479c0b7ba0 0x7f479c151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:18.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.852+0000 7f47a21b3700 1 -- 172.21.15.3:0/3047687137 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4798009550 con 0x7f479c148c10 2023-03-06T14:16:18.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.852+0000 7f47a11b1700 1 --2- 172.21.15.3:0/3047687137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f479c0b7ba0 0x7f479c151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:18.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.852+0000 7f47a21b3700 1 --2- 172.21.15.3:0/3047687137 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c148c10 0x7f479c143b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f479400cc10 tx=0x7f479400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:18.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.852+0000 7f47927fc700 1 -- 172.21.15.3:0/3047687137 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479400ab10 con 0x7f479c148c10 2023-03-06T14:16:18.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.852+0000 7f47927fc700 1 -- 172.21.15.3:0/3047687137 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479400ac70 con 0x7f479c148c10 2023-03-06T14:16:18.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.852+0000 7f47927fc700 1 -- 172.21.15.3:0/3047687137 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794012420 con 0x7f479c148c10 2023-03-06T14:16:18.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.852+0000 7f47a3c16700 1 -- 172.21.15.3:0/3047687137 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c152730 con 0x7f479c148c10 2023-03-06T14:16:18.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.852+0000 7f47a3c16700 1 -- 172.21.15.3:0/3047687137 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c06f440 con 0x7f479c148c10 2023-03-06T14:16:18.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.853+0000 7f47a3c16700 1 -- 172.21.15.3:0/3047687137 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c0c0390 con 0x7f479c148c10 2023-03-06T14:16:18.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.854+0000 7f47927fc700 1 -- 172.21.15.3:0/3047687137 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4794010050 con 0x7f479c148c10 2023-03-06T14:16:18.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.854+0000 7f47927fc700 1 --2- 172.21.15.3:0/3047687137 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f47800682f0 0x7f478006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:18.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.854+0000 7f47927fc700 1 -- 172.21.15.3:0/3047687137 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f47940861d0 con 0x7f479c148c10 2023-03-06T14:16:18.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.854+0000 7f47a19b2700 1 --2- 172.21.15.3:0/3047687137 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f47800682f0 0x7f478006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:18.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.855+0000 7f47a19b2700 1 --2- 172.21.15.3:0/3047687137 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f47800682f0 0x7f478006a7a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4798009130 tx=0x7f4798008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:18.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:18.858+0000 7f47927fc700 1 -- 172.21.15.3:0/3047687137 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4794052740 con 0x7f479c148c10 2023-03-06T14:16:19.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.108+0000 7f47a3c16700 1 -- 172.21.15.3:0/3047687137 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f479c153470 con 0x7f479c148c10 2023-03-06T14:16:19.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.111+0000 7f47927fc700 1 -- 172.21.15.3:0/3047687137 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+166382 (secure 0 0 0) 0x7f4794055d60 con 0x7f479c148c10 2023-03-06T14:16:19.114 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:19.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.114+0000 7f47a3c16700 1 -- 172.21.15.3:0/3047687137 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f47800682f0 msgr2=0x7f478006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:19.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.114+0000 7f47a3c16700 1 --2- 172.21.15.3:0/3047687137 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f47800682f0 0x7f478006a7a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4798009130 tx=0x7f4798008030 comp rx=0 tx=0).stop 2023-03-06T14:16:19.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.114+0000 7f47a3c16700 1 -- 172.21.15.3:0/3047687137 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c148c10 msgr2=0x7f479c143b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:19.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.114+0000 7f47a3c16700 1 --2- 172.21.15.3:0/3047687137 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c148c10 0x7f479c143b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f479400cc10 tx=0x7f479400cf20 comp rx=0 tx=0).stop 2023-03-06T14:16:19.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.114+0000 7f47a3c16700 1 -- 172.21.15.3:0/3047687137 shutdown_connections 2023-03-06T14:16:19.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.114+0000 7f47a3c16700 1 --2- 172.21.15.3:0/3047687137 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f47800682f0 0x7f478006a7a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.114+0000 7f47a3c16700 1 --2- 172.21.15.3:0/3047687137 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c148c10 0x7f479c143b00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.114+0000 7f47a3c16700 1 --2- 172.21.15.3:0/3047687137 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f479c0b77d0 0x7f479c0bfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.114+0000 7f47a3c16700 1 --2- 172.21.15.3:0/3047687137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f479c0b7ba0 0x7f479c151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.114+0000 7f47a3c16700 1 -- 172.21.15.3:0/3047687137 >> 172.21.15.3:0/3047687137 conn(0x7f479c0c17d0 msgr2=0x7f479c0be930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:19.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.114+0000 7f47a3c16700 1 -- 172.21.15.3:0/3047687137 shutdown_connections 2023-03-06T14:16:19.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.114+0000 7f47a3c16700 1 -- 172.21.15.3:0/3047687137 wait complete. 2023-03-06T14:16:19.127 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":5,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":96144},{"type":"v1","addr":"172.21.15.136:6833","nonce":96144}]},"active_addr":"172.21.15.136:6833/96144","active_change":"2023-03-06T14:15:38.953806+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":2879861219}]},{"addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":2509160935}]},{"addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":816205448}]},{"addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":1451352197}]}]} 2023-03-06T14:16:19.133 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-03-06T14:16:19.134 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-03-06T14:16:19.134 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T14:16:19.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.257+0000 7fb8750a6700 1 Processor -- start 2023-03-06T14:16:19.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.257+0000 7fb8750a6700 1 -- start start 2023-03-06T14:16:19.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.258+0000 7fb8750a6700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb8700bdde0 0x7fb870145420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:19.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.258+0000 7fb8750a6700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb870072a30 con 0x7fb8700a2ea0 2023-03-06T14:16:19.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.258+0000 7fb8750a6700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87006f0f0 con 0x7fb8700bda10 2023-03-06T14:16:19.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.258+0000 7fb8750a6700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87006e9b0 con 0x7fb8700bdde0 2023-03-06T14:16:19.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.258+0000 7fb86e59c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb8700bdde0 0x7fb870145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:19.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.258+0000 7fb86f59e700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb8700a2ea0 0x7fb870155e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58326/0 (socket says 172.21.15.3:58326) 2023-03-06T14:16:19.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.258+0000 7fb86e59c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb8700bdde0 0x7fb870145420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56052/0 (socket says 172.21.15.3:56052) 2023-03-06T14:16:19.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.258+0000 7fb86f59e700 1 -- 172.21.15.3:0/2082994250 learned_addr learned my addr 172.21.15.3:0/2082994250 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:19.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.259+0000 7fb86e59c700 1 -- 172.21.15.3:0/2082994250 >> v1:172.21.15.136:6789/0 conn(0x7fb8700bda10 legacy=0x7fb87014f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:19.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.259+0000 7fb86e59c700 1 -- 172.21.15.3:0/2082994250 >> v1:172.21.15.3:6789/0 conn(0x7fb8700a2ea0 legacy=0x7fb870155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:19.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.259+0000 7fb86dd9b700 1 -- 172.21.15.3:0/2082994250 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314608824 0 0) 0x7fb870072a30 con 0x7fb8700a2ea0 2023-03-06T14:16:19.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.259+0000 7fb86e59c700 1 -- 172.21.15.3:0/2082994250 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87006f390 con 0x7fb8700bdde0 2023-03-06T14:16:19.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.259+0000 7fb86e59c700 1 --2- 172.21.15.3:0/2082994250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8700bdde0 0x7fb870145420 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb860009840 tx=0x7fb860009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e100ef5884dac9b server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:19.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.259+0000 7fb86dd9b700 1 -- 172.21.15.3:0/2082994250 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb860011830 con 0x7fb8700bdde0 2023-03-06T14:16:19.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.259+0000 7fb86dd9b700 1 -- 172.21.15.3:0/2082994250 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb860011990 con 0x7fb8700bdde0 2023-03-06T14:16:19.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.259+0000 7fb86dd9b700 1 -- 172.21.15.3:0/2082994250 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb860011d20 con 0x7fb8700bdde0 2023-03-06T14:16:19.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.259+0000 7fb8750a6700 1 -- 172.21.15.3:0/2082994250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8700bdde0 msgr2=0x7fb870145420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:19.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.259+0000 7fb8750a6700 1 --2- 172.21.15.3:0/2082994250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8700bdde0 0x7fb870145420 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb860009840 tx=0x7fb860009b50 comp rx=0 tx=0).stop 2023-03-06T14:16:19.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.259+0000 7fb8750a6700 1 -- 172.21.15.3:0/2082994250 shutdown_connections 2023-03-06T14:16:19.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.259+0000 7fb8750a6700 1 --2- 172.21.15.3:0/2082994250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8700bdde0 0x7fb870145420 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.259+0000 7fb8750a6700 1 -- 172.21.15.3:0/2082994250 >> 172.21.15.3:0/2082994250 conn(0x7fb8700c17d0 msgr2=0x7fb8700c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:19.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.260+0000 7fb8750a6700 1 -- 172.21.15.3:0/2082994250 shutdown_connections 2023-03-06T14:16:19.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.260+0000 7fb8750a6700 1 -- 172.21.15.3:0/2082994250 wait complete. 2023-03-06T14:16:19.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.261+0000 7fb8750a6700 1 Processor -- start 2023-03-06T14:16:19.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.261+0000 7fb8750a6700 1 -- start start 2023-03-06T14:16:19.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.262+0000 7fb8750a6700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8700a2ea0 0x7fb8700c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:19.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.262+0000 7fb8750a6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8700bda10 0x7fb8701e52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:19.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.262+0000 7fb8750a6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8700bdde0 0x7fb8701e1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:19.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.262+0000 7fb8750a6700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb870141110 con 0x7fb8700bda10 2023-03-06T14:16:19.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.262+0000 7fb8750a6700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87014c090 con 0x7fb8700bdde0 2023-03-06T14:16:19.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.262+0000 7fb8750a6700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb870148dc0 con 0x7fb8700a2ea0 2023-03-06T14:16:19.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.262+0000 7fb86e59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8700bda10 0x7fb8701e52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:19.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.262+0000 7fb86e59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8700bda10 0x7fb8701e52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56058/0 (socket says 172.21.15.3:56058) 2023-03-06T14:16:19.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.262+0000 7fb86e59c700 1 -- 172.21.15.3:0/193258606 learned_addr learned my addr 172.21.15.3:0/193258606 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:19.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.263+0000 7fb86ed9d700 1 --2- 172.21.15.3:0/193258606 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8700a2ea0 0x7fb8700c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:19.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.263+0000 7fb86f59e700 1 --2- 172.21.15.3:0/193258606 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8700bdde0 0x7fb8701e1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:19.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.263+0000 7fb86e59c700 1 -- 172.21.15.3:0/193258606 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8700a2ea0 msgr2=0x7fb8700c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:19.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.263+0000 7fb86e59c700 1 --2- 172.21.15.3:0/193258606 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8700a2ea0 0x7fb8700c0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.263+0000 7fb86e59c700 1 -- 172.21.15.3:0/193258606 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8700bdde0 msgr2=0x7fb8701e1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:19.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.263+0000 7fb86e59c700 1 --2- 172.21.15.3:0/193258606 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8700bdde0 0x7fb8701e1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.263+0000 7fb86e59c700 1 -- 172.21.15.3:0/193258606 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8600094a0 con 0x7fb8700bda10 2023-03-06T14:16:19.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.263+0000 7fb86f59e700 1 --2- 172.21.15.3:0/193258606 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8700bdde0 0x7fb8701e1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:16:19.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.263+0000 7fb86e59c700 1 --2- 172.21.15.3:0/193258606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8700bda10 0x7fb8701e52e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb860014040 tx=0x7fb860004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:19.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.263+0000 7fb8677fe700 1 -- 172.21.15.3:0/193258606 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86001a900 con 0x7fb8700bda10 2023-03-06T14:16:19.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.263+0000 7fb8677fe700 1 -- 172.21.15.3:0/193258606 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86001aa60 con 0x7fb8700bda10 2023-03-06T14:16:19.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.263+0000 7fb8677fe700 1 -- 172.21.15.3:0/193258606 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86001add0 con 0x7fb8700bda10 2023-03-06T14:16:19.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.263+0000 7fb8750a6700 1 -- 172.21.15.3:0/193258606 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb870070d40 con 0x7fb8700bda10 2023-03-06T14:16:19.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.263+0000 7fb8750a6700 1 -- 172.21.15.3:0/193258606 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87014ec10 con 0x7fb8700bda10 2023-03-06T14:16:19.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.264+0000 7fb8750a6700 1 -- 172.21.15.3:0/193258606 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87014f840 con 0x7fb8700bda10 2023-03-06T14:16:19.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.265+0000 7fb8677fe700 1 -- 172.21.15.3:0/193258606 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb86000f050 con 0x7fb8700bda10 2023-03-06T14:16:19.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.265+0000 7fb8677fe700 1 --2- 172.21.15.3:0/193258606 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb8500682f0 0x7fb85006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:19.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.265+0000 7fb8677fe700 1 -- 172.21.15.3:0/193258606 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb860086f80 con 0x7fb8700bda10 2023-03-06T14:16:19.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.265+0000 7fb86ed9d700 1 --2- 172.21.15.3:0/193258606 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb8500682f0 0x7fb85006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:19.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.266+0000 7fb86ed9d700 1 --2- 172.21.15.3:0/193258606 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb8500682f0 0x7fb85006a7a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb858000f60 tx=0x7fb858009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:19.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.269+0000 7fb8677fe700 1 -- 172.21.15.3:0/193258606 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb860053520 con 0x7fb8700bda10 2023-03-06T14:16:19.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.465+0000 7fb8750a6700 1 -- 172.21.15.3:0/193258606 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb87014e6e0 con 0x7fb8700bda10 2023-03-06T14:16:19.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.466+0000 7fb8677fe700 1 -- 172.21.15.3:0/193258606 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19604 (secure 0 0 0) 0x7fb860029090 con 0x7fb8700bda10 2023-03-06T14:16:19.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:19.469 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":27,"fsid":"9aae2361-5af0-49eb-8f99-e7f69834fedf","created":"2023-03-06T14:15:33.357348+0000","modified":"2023-03-06T14:16:03.040402+0000","last_up_change":"2023-03-06T14:15:44.374764+0000","last_in_change":"2023-03-06T14:15:35.866803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T14:15:45.023761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T14:15:51.830917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-06T14:15:56.256188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-06T14:15:57.571429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-06T14:16:00.645210+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c92c9e49-8a23-48a5-87e5-51f184f73a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":96679},{"type":"v1","addr":"172.21.15.3:6809","nonce":96679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":96679},{"type":"v1","addr":"172.21.15.3:6811","nonce":96679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":96679},{"type":"v1","addr":"172.21.15.3:6818","nonce":96679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":96679},{"type":"v1","addr":"172.21.15.3:6814","nonce":96679}]},"public_addr":"172.21.15.3:6809/96679","cluster_addr":"172.21.15.3:6811/96679","heartbeat_back_addr":"172.21.15.3:6818/96679","heartbeat_front_addr":"172.21.15.3:6814/96679","state":["exists","up"]},{"osd":1,"uuid":"86ec9127-843f-4246-bfbe-e14ce3af7d17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":96681},{"type":"v1","addr":"172.21.15.3:6825","nonce":96681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":96681},{"type":"v1","addr":"172.21.15.3:6827","nonce":96681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":96681},{"type":"v1","addr":"172.21.15.3:6831","nonce":96681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":96681},{"type":"v1","addr":"172.21.15.3:6829","nonce":96681}]},"public_addr":"172.21.15.3:6825/96681","cluster_addr":"172.21.15.3:6827/96681","heartbeat_back_addr":"172.21.15.3:6831/96681","heartbeat_front_addr":"172.21.15.3:6829/96681","state":["exists","up"]},{"osd":2,"uuid":"67582de3-0f75-4cf0-84ca-e878986f99f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":96682},{"type":"v1","addr":"172.21.15.3:6815","nonce":96682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6817","nonce":96682},{"type":"v1","addr":"172.21.15.3:6819","nonce":96682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":96682},{"type":"v1","addr":"172.21.15.3:6823","nonce":96682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":96682},{"type":"v1","addr":"172.21.15.3:6821","nonce":96682}]},"public_addr":"172.21.15.3:6815/96682","cluster_addr":"172.21.15.3:6819/96682","heartbeat_back_addr":"172.21.15.3:6823/96682","heartbeat_front_addr":"172.21.15.3:6821/96682","state":["exists","up"]},{"osd":3,"uuid":"0fb8d708-4b38-4153-8a60-79741765d439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":96680},{"type":"v1","addr":"172.21.15.3:6801","nonce":96680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":96680},{"type":"v1","addr":"172.21.15.3:6803","nonce":96680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":96680},{"type":"v1","addr":"172.21.15.3:6807","nonce":96680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":96680},{"type":"v1","addr":"172.21.15.3:6805","nonce":96680}]},"public_addr":"172.21.15.3:6801/96680","cluster_addr":"172.21.15.3:6803/96680","heartbeat_back_addr":"172.21.15.3:6807/96680","heartbeat_front_addr":"172.21.15.3:6805/96680","state":["exists","up"]},{"osd":4,"uuid":"44eb9d99-975f-43a3-8bf4-213b2ba6dea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":96798},{"type":"v1","addr":"172.21.15.136:6822","nonce":96798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":96798},{"type":"v1","addr":"172.21.15.136:6826","nonce":96798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":96798},{"type":"v1","addr":"172.21.15.136:6831","nonce":96798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":96798},{"type":"v1","addr":"172.21.15.136:6829","nonce":96798}]},"public_addr":"172.21.15.136:6822/96798","cluster_addr":"172.21.15.136:6826/96798","heartbeat_back_addr":"172.21.15.136:6831/96798","heartbeat_front_addr":"172.21.15.136:6829/96798","state":["exists","up"]},{"osd":5,"uuid":"aff1a438-c444-4ebc-9806-d2d117878a2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":96796},{"type":"v1","addr":"172.21.15.136:6804","nonce":96796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":96796},{"type":"v1","addr":"172.21.15.136:6809","nonce":96796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":96796},{"type":"v1","addr":"172.21.15.136:6815","nonce":96796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":96796},{"type":"v1","addr":"172.21.15.136:6813","nonce":96796}]},"public_addr":"172.21.15.136:6804/96796","cluster_addr":"172.21.15.136:6809/96796","heartbeat_back_addr":"172.21.15.136:6815/96796","heartbeat_front_addr":"172.21.15.136:6813/96796","state":["exists","up"]},{"osd":6,"uuid":"89cc219c-f57b-43f4-8e54-76017dd4930d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":96797},{"type":"v1","addr":"172.21.15.136:6801","nonce":96797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6803","nonce":96797},{"type":"v1","addr":"172.21.15.136:6805","nonce":96797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":96797},{"type":"v1","addr":"172.21.15.136:6811","nonce":96797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":96797},{"type":"v1","addr":"172.21.15.136:6808","nonce":96797}]},"public_addr":"172.21.15.136:6801/96797","cluster_addr":"172.21.15.136:6805/96797","heartbeat_back_addr":"172.21.15.136:6811/96797","heartbeat_front_addr":"172.21.15.136:6808/96797","state":["exists","up"]},{"osd":7,"uuid":"a90e4c14-00de-4d1c-92ce-9f20df714e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":96819},{"type":"v1","addr":"172.21.15.136:6817","nonce":96819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":96819},{"type":"v1","addr":"172.21.15.136:6819","nonce":96819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":96819},{"type":"v1","addr":"172.21.15.136:6827","nonce":96819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":96819},{"type":"v1","addr":"172.21.15.136:6823","nonce":96819}]},"public_addr":"172.21.15.136:6817/96819","cluster_addr":"172.21.15.136:6819/96819","heartbeat_back_addr":"172.21.15.136:6827/96819","heartbeat_front_addr":"172.21.15.136:6823/96819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.093141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.034488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.128137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.097924+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.045441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.005820+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.039918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.082053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T14:16:19.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.468+0000 7fb8750a6700 1 -- 172.21.15.3:0/193258606 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb8500682f0 msgr2=0x7fb85006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:19.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.468+0000 7fb8750a6700 1 --2- 172.21.15.3:0/193258606 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb8500682f0 0x7fb85006a7a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb858000f60 tx=0x7fb858009040 comp rx=0 tx=0).stop 2023-03-06T14:16:19.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.468+0000 7fb8750a6700 1 -- 172.21.15.3:0/193258606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8700bda10 msgr2=0x7fb8701e52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:19.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.468+0000 7fb8750a6700 1 --2- 172.21.15.3:0/193258606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8700bda10 0x7fb8701e52e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb860014040 tx=0x7fb860004750 comp rx=0 tx=0).stop 2023-03-06T14:16:19.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.468+0000 7fb8750a6700 1 -- 172.21.15.3:0/193258606 shutdown_connections 2023-03-06T14:16:19.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.468+0000 7fb8750a6700 1 --2- 172.21.15.3:0/193258606 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb8500682f0 0x7fb85006a7a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.468+0000 7fb8750a6700 1 --2- 172.21.15.3:0/193258606 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8700bdde0 0x7fb8701e1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.468+0000 7fb8750a6700 1 --2- 172.21.15.3:0/193258606 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8700a2ea0 0x7fb8700c0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.468+0000 7fb8750a6700 1 --2- 172.21.15.3:0/193258606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8700bda10 0x7fb8701e52e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.468+0000 7fb8750a6700 1 -- 172.21.15.3:0/193258606 >> 172.21.15.3:0/193258606 conn(0x7fb8700c17d0 msgr2=0x7fb8700c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:19.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.468+0000 7fb8750a6700 1 -- 172.21.15.3:0/193258606 shutdown_connections 2023-03-06T14:16:19.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.468+0000 7fb8750a6700 1 -- 172.21.15.3:0/193258606 wait complete. 2023-03-06T14:16:19.482 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-03-06T14:16:19.483 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T14:16:19.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.605+0000 7f0e67ca3700 1 Processor -- start 2023-03-06T14:16:19.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.606+0000 7f0e67ca3700 1 -- start start 2023-03-06T14:16:19.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.606+0000 7f0e67ca3700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0e600c1fe0 0x7f0e600c0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:19.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.606+0000 7f0e67ca3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e6006fde0 0x7f0e600beb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:19.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.606+0000 7f0e67ca3700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e60070670 con 0x7f0e600bf040 2023-03-06T14:16:19.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.606+0000 7f0e67ca3700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e600c23b0 con 0x7f0e600c1fe0 2023-03-06T14:16:19.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.606+0000 7f0e67ca3700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e60151070 con 0x7f0e6006fde0 2023-03-06T14:16:19.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.606+0000 7f0e65a3f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0e600c1fe0 0x7f0e600c0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:19.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.606+0000 7f0e65a3f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0e600c1fe0 0x7f0e600c0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56064/0 (socket says 172.21.15.3:56064) 2023-03-06T14:16:19.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.606+0000 7f0e65a3f700 1 -- 172.21.15.3:0/699105302 learned_addr learned my addr 172.21.15.3:0/699105302 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:19.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.607+0000 7f0e6523e700 1 --2- 172.21.15.3:0/699105302 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e6006fde0 0x7f0e600beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:19.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.607+0000 7f0e65a3f700 1 -- 172.21.15.3:0/699105302 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e6006fde0 msgr2=0x7f0e600beb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:19.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.607+0000 7f0e65a3f700 1 --2- 172.21.15.3:0/699105302 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e6006fde0 0x7f0e600beb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.607+0000 7f0e65a3f700 1 -- 172.21.15.3:0/699105302 >> v1:172.21.15.136:6789/0 conn(0x7f0e600bf040 legacy=0x7f0e60146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:19.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.607+0000 7f0e65a3f700 1 -- 172.21.15.3:0/699105302 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e60151350 con 0x7f0e600c1fe0 2023-03-06T14:16:19.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.607+0000 7f0e65a3f700 1 --2- 172.21.15.3:0/699105302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e600c1fe0 0x7f0e600c0fd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c0098f0 tx=0x7f0e5c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43af8552e1f70d5f server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:19.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.607+0000 7f0e64a3d700 1 -- 172.21.15.3:0/699105302 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c00b8a0 con 0x7f0e600c1fe0 2023-03-06T14:16:19.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.607+0000 7f0e64a3d700 1 -- 172.21.15.3:0/699105302 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5c00ba00 con 0x7f0e600c1fe0 2023-03-06T14:16:19.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.607+0000 7f0e64a3d700 1 -- 172.21.15.3:0/699105302 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c00bd90 con 0x7f0e600c1fe0 2023-03-06T14:16:19.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.608+0000 7f0e67ca3700 1 -- 172.21.15.3:0/699105302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e600c1fe0 msgr2=0x7f0e600c0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:19.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.608+0000 7f0e67ca3700 1 --2- 172.21.15.3:0/699105302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e600c1fe0 0x7f0e600c0fd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c0098f0 tx=0x7f0e5c009c00 comp rx=0 tx=0).stop 2023-03-06T14:16:19.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.608+0000 7f0e67ca3700 1 -- 172.21.15.3:0/699105302 shutdown_connections 2023-03-06T14:16:19.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.608+0000 7f0e67ca3700 1 --2- 172.21.15.3:0/699105302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e600c1fe0 0x7f0e600c0fd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.608+0000 7f0e67ca3700 1 --2- 172.21.15.3:0/699105302 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e6006fde0 0x7f0e600beb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.608+0000 7f0e67ca3700 1 -- 172.21.15.3:0/699105302 >> 172.21.15.3:0/699105302 conn(0x7f0e600c31d0 msgr2=0x7f0e600c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:19.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.608+0000 7f0e67ca3700 1 -- 172.21.15.3:0/699105302 shutdown_connections 2023-03-06T14:16:19.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.608+0000 7f0e67ca3700 1 -- 172.21.15.3:0/699105302 wait complete. 2023-03-06T14:16:19.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.609+0000 7f0e67ca3700 1 Processor -- start 2023-03-06T14:16:19.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.609+0000 7f0e67ca3700 1 -- start start 2023-03-06T14:16:19.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e67ca3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e6006fde0 0x7f0e601e4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:19.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e67ca3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e600bf040 0x7f0e600b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:19.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e67ca3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e600c1fe0 0x7f0e600b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:19.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e67ca3700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e601e5300 con 0x7f0e600c1fe0 2023-03-06T14:16:19.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e67ca3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e601e5570 con 0x7f0e600bf040 2023-03-06T14:16:19.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e67ca3700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e601e5810 con 0x7f0e6006fde0 2023-03-06T14:16:19.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e66240700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e600c1fe0 0x7f0e600b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:19.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e66240700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e600c1fe0 0x7f0e600b8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56072/0 (socket says 172.21.15.3:56072) 2023-03-06T14:16:19.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e66240700 1 -- 172.21.15.3:0/2880217506 learned_addr learned my addr 172.21.15.3:0/2880217506 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:19.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e6523e700 1 --2- 172.21.15.3:0/2880217506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e600bf040 0x7f0e600b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:19.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e65a3f700 1 --2- 172.21.15.3:0/2880217506 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e6006fde0 0x7f0e601e4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:19.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e66240700 1 -- 172.21.15.3:0/2880217506 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e6006fde0 msgr2=0x7f0e601e4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:19.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e66240700 1 --2- 172.21.15.3:0/2880217506 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e6006fde0 0x7f0e601e4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e66240700 1 -- 172.21.15.3:0/2880217506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e600bf040 msgr2=0x7f0e600b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:19.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e66240700 1 --2- 172.21.15.3:0/2880217506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e600bf040 0x7f0e600b6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e66240700 1 -- 172.21.15.3:0/2880217506 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5c009550 con 0x7f0e600c1fe0 2023-03-06T14:16:19.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e66240700 1 --2- 172.21.15.3:0/2880217506 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e600c1fe0 0x7f0e600b8c40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800cb50 tx=0x7f0e5800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:19.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e527fc700 1 -- 172.21.15.3:0/2880217506 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e58003c00 con 0x7f0e600c1fe0 2023-03-06T14:16:19.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e527fc700 1 -- 172.21.15.3:0/2880217506 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e58003d60 con 0x7f0e600c1fe0 2023-03-06T14:16:19.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e67ca3700 1 -- 172.21.15.3:0/2880217506 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e600bf9f0 con 0x7f0e600c1fe0 2023-03-06T14:16:19.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e527fc700 1 -- 172.21.15.3:0/2880217506 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5800aa20 con 0x7f0e600c1fe0 2023-03-06T14:16:19.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.610+0000 7f0e67ca3700 1 -- 172.21.15.3:0/2880217506 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e600c2600 con 0x7f0e600c1fe0 2023-03-06T14:16:19.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.611+0000 7f0e67ca3700 1 -- 172.21.15.3:0/2880217506 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e600c2b20 con 0x7f0e600c1fe0 2023-03-06T14:16:19.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.612+0000 7f0e527fc700 1 -- 172.21.15.3:0/2880217506 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0e58010050 con 0x7f0e600c1fe0 2023-03-06T14:16:19.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.612+0000 7f0e527fc700 1 --2- 172.21.15.3:0/2880217506 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0e440682f0 0x7f0e4406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:19.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.612+0000 7f0e527fc700 1 -- 172.21.15.3:0/2880217506 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0e58085e10 con 0x7f0e600c1fe0 2023-03-06T14:16:19.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.613+0000 7f0e65a3f700 1 --2- 172.21.15.3:0/2880217506 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0e440682f0 0x7f0e4406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:19.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.613+0000 7f0e65a3f700 1 --2- 172.21.15.3:0/2880217506 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0e440682f0 0x7f0e4406a7a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009c40 tx=0x7f0e5c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:19.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.617+0000 7f0e527fc700 1 -- 172.21.15.3:0/2880217506 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0e58052380 con 0x7f0e600c1fe0 2023-03-06T14:16:19.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.812+0000 7f0e67ca3700 1 -- 172.21.15.3:0/2880217506 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e600bf6a0 con 0x7f0e600c1fe0 2023-03-06T14:16:19.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.813+0000 7f0e527fc700 1 -- 172.21.15.3:0/2880217506 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19604 (secure 0 0 0) 0x7f0e580559a0 con 0x7f0e600c1fe0 2023-03-06T14:16:19.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:19.815 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":27,"fsid":"9aae2361-5af0-49eb-8f99-e7f69834fedf","created":"2023-03-06T14:15:33.357348+0000","modified":"2023-03-06T14:16:03.040402+0000","last_up_change":"2023-03-06T14:15:44.374764+0000","last_in_change":"2023-03-06T14:15:35.866803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T14:15:45.023761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T14:15:51.830917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-06T14:15:56.256188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-06T14:15:57.571429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-06T14:16:00.645210+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c92c9e49-8a23-48a5-87e5-51f184f73a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":96679},{"type":"v1","addr":"172.21.15.3:6809","nonce":96679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":96679},{"type":"v1","addr":"172.21.15.3:6811","nonce":96679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":96679},{"type":"v1","addr":"172.21.15.3:6818","nonce":96679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":96679},{"type":"v1","addr":"172.21.15.3:6814","nonce":96679}]},"public_addr":"172.21.15.3:6809/96679","cluster_addr":"172.21.15.3:6811/96679","heartbeat_back_addr":"172.21.15.3:6818/96679","heartbeat_front_addr":"172.21.15.3:6814/96679","state":["exists","up"]},{"osd":1,"uuid":"86ec9127-843f-4246-bfbe-e14ce3af7d17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":96681},{"type":"v1","addr":"172.21.15.3:6825","nonce":96681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":96681},{"type":"v1","addr":"172.21.15.3:6827","nonce":96681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":96681},{"type":"v1","addr":"172.21.15.3:6831","nonce":96681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":96681},{"type":"v1","addr":"172.21.15.3:6829","nonce":96681}]},"public_addr":"172.21.15.3:6825/96681","cluster_addr":"172.21.15.3:6827/96681","heartbeat_back_addr":"172.21.15.3:6831/96681","heartbeat_front_addr":"172.21.15.3:6829/96681","state":["exists","up"]},{"osd":2,"uuid":"67582de3-0f75-4cf0-84ca-e878986f99f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":96682},{"type":"v1","addr":"172.21.15.3:6815","nonce":96682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6817","nonce":96682},{"type":"v1","addr":"172.21.15.3:6819","nonce":96682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":96682},{"type":"v1","addr":"172.21.15.3:6823","nonce":96682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":96682},{"type":"v1","addr":"172.21.15.3:6821","nonce":96682}]},"public_addr":"172.21.15.3:6815/96682","cluster_addr":"172.21.15.3:6819/96682","heartbeat_back_addr":"172.21.15.3:6823/96682","heartbeat_front_addr":"172.21.15.3:6821/96682","state":["exists","up"]},{"osd":3,"uuid":"0fb8d708-4b38-4153-8a60-79741765d439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":96680},{"type":"v1","addr":"172.21.15.3:6801","nonce":96680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":96680},{"type":"v1","addr":"172.21.15.3:6803","nonce":96680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":96680},{"type":"v1","addr":"172.21.15.3:6807","nonce":96680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":96680},{"type":"v1","addr":"172.21.15.3:6805","nonce":96680}]},"public_addr":"172.21.15.3:6801/96680","cluster_addr":"172.21.15.3:6803/96680","heartbeat_back_addr":"172.21.15.3:6807/96680","heartbeat_front_addr":"172.21.15.3:6805/96680","state":["exists","up"]},{"osd":4,"uuid":"44eb9d99-975f-43a3-8bf4-213b2ba6dea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":96798},{"type":"v1","addr":"172.21.15.136:6822","nonce":96798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":96798},{"type":"v1","addr":"172.21.15.136:6826","nonce":96798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":96798},{"type":"v1","addr":"172.21.15.136:6831","nonce":96798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":96798},{"type":"v1","addr":"172.21.15.136:6829","nonce":96798}]},"public_addr":"172.21.15.136:6822/96798","cluster_addr":"172.21.15.136:6826/96798","heartbeat_back_addr":"172.21.15.136:6831/96798","heartbeat_front_addr":"172.21.15.136:6829/96798","state":["exists","up"]},{"osd":5,"uuid":"aff1a438-c444-4ebc-9806-d2d117878a2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":96796},{"type":"v1","addr":"172.21.15.136:6804","nonce":96796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":96796},{"type":"v1","addr":"172.21.15.136:6809","nonce":96796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":96796},{"type":"v1","addr":"172.21.15.136:6815","nonce":96796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":96796},{"type":"v1","addr":"172.21.15.136:6813","nonce":96796}]},"public_addr":"172.21.15.136:6804/96796","cluster_addr":"172.21.15.136:6809/96796","heartbeat_back_addr":"172.21.15.136:6815/96796","heartbeat_front_addr":"172.21.15.136:6813/96796","state":["exists","up"]},{"osd":6,"uuid":"89cc219c-f57b-43f4-8e54-76017dd4930d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":96797},{"type":"v1","addr":"172.21.15.136:6801","nonce":96797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6803","nonce":96797},{"type":"v1","addr":"172.21.15.136:6805","nonce":96797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":96797},{"type":"v1","addr":"172.21.15.136:6811","nonce":96797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":96797},{"type":"v1","addr":"172.21.15.136:6808","nonce":96797}]},"public_addr":"172.21.15.136:6801/96797","cluster_addr":"172.21.15.136:6805/96797","heartbeat_back_addr":"172.21.15.136:6811/96797","heartbeat_front_addr":"172.21.15.136:6808/96797","state":["exists","up"]},{"osd":7,"uuid":"a90e4c14-00de-4d1c-92ce-9f20df714e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":96819},{"type":"v1","addr":"172.21.15.136:6817","nonce":96819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":96819},{"type":"v1","addr":"172.21.15.136:6819","nonce":96819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":96819},{"type":"v1","addr":"172.21.15.136:6827","nonce":96819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":96819},{"type":"v1","addr":"172.21.15.136:6823","nonce":96819}]},"public_addr":"172.21.15.136:6817/96819","cluster_addr":"172.21.15.136:6819/96819","heartbeat_back_addr":"172.21.15.136:6827/96819","heartbeat_front_addr":"172.21.15.136:6823/96819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.093141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.034488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.128137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.097924+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.045441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.005820+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.039918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.082053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T14:16:19.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.815+0000 7f0e67ca3700 1 -- 172.21.15.3:0/2880217506 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0e440682f0 msgr2=0x7f0e4406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:19.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.815+0000 7f0e67ca3700 1 --2- 172.21.15.3:0/2880217506 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0e440682f0 0x7f0e4406a7a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009c40 tx=0x7f0e5c008030 comp rx=0 tx=0).stop 2023-03-06T14:16:19.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.815+0000 7f0e67ca3700 1 -- 172.21.15.3:0/2880217506 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e600c1fe0 msgr2=0x7f0e600b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:19.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.815+0000 7f0e67ca3700 1 --2- 172.21.15.3:0/2880217506 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e600c1fe0 0x7f0e600b8c40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800cb50 tx=0x7f0e5800ce60 comp rx=0 tx=0).stop 2023-03-06T14:16:19.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.815+0000 7f0e67ca3700 1 -- 172.21.15.3:0/2880217506 shutdown_connections 2023-03-06T14:16:19.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.815+0000 7f0e67ca3700 1 --2- 172.21.15.3:0/2880217506 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0e440682f0 0x7f0e4406a7a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.815+0000 7f0e67ca3700 1 --2- 172.21.15.3:0/2880217506 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e600c1fe0 0x7f0e600b8c40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.815+0000 7f0e67ca3700 1 --2- 172.21.15.3:0/2880217506 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e6006fde0 0x7f0e601e4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.815+0000 7f0e67ca3700 1 --2- 172.21.15.3:0/2880217506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e600bf040 0x7f0e600b6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:19.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.815+0000 7f0e67ca3700 1 -- 172.21.15.3:0/2880217506 >> 172.21.15.3:0/2880217506 conn(0x7f0e600c31d0 msgr2=0x7f0e600a3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:19.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.815+0000 7f0e67ca3700 1 -- 172.21.15.3:0/2880217506 shutdown_connections 2023-03-06T14:16:19.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:19.815+0000 7f0e67ca3700 1 -- 172.21.15.3:0/2880217506 wait complete. 2023-03-06T14:16:19.829 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-03-06T14:16:19.829 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-03-06T14:16:19.830 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-03-06T14:16:19.830 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-03-06T14:16:19.831 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-03-06T14:16:19.831 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-03-06T14:16:19.832 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-03-06T14:16:19.832 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-03-06T14:16:20.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.041+0000 7f6fa0900700 1 Processor -- start 2023-03-06T14:16:20.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.041+0000 7f6fa0900700 1 -- start start 2023-03-06T14:16:20.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.043+0000 7f6fa0900700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6f9c1488d0 0x7f6f9c0b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.043+0000 7f6fa0900700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f9c0b69e0 0x7f6f9c0b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.043+0000 7f6fa0900700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6f9c14e670 0x7f6f9c14ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.043+0000 7f6fa0900700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f9c0b7610 con 0x7f6f9c14e670 2023-03-06T14:16:20.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.043+0000 7f6fa0900700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f9c0bd330 con 0x7f6f9c1488d0 2023-03-06T14:16:20.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.043+0000 7f6fa0900700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c0bbef0 con 0x7f6f9c0b69e0 2023-03-06T14:16:20.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.044+0000 7f6f99d9b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f9c0b69e0 0x7f6f9c0b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.044+0000 7f6f99d9b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f9c0b69e0 0x7f6f9c0b6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.3:49058/0 (socket says 172.21.15.3:49058) 2023-03-06T14:16:20.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.044+0000 7f6f99d9b700 1 -- 172.21.15.3:0/3215477531 learned_addr learned my addr 172.21.15.3:0/3215477531 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.044+0000 7f6f9a59c700 1 --2- 172.21.15.3:0/3215477531 >> v2:172.21.15.136:3300/0 conn(0x7f6f9c1488d0 0x7f6f9c0b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.044+0000 7f6f99d9b700 1 -- 172.21.15.3:0/3215477531 >> v2:172.21.15.136:3300/0 conn(0x7f6f9c1488d0 msgr2=0x7f6f9c0b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.044+0000 7f6f99d9b700 1 --2- 172.21.15.3:0/3215477531 >> v2:172.21.15.136:3300/0 conn(0x7f6f9c1488d0 0x7f6f9c0b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.044+0000 7f6f99d9b700 1 -- 172.21.15.3:0/3215477531 >> v2:172.21.15.3:3300/0 conn(0x7f6f9c14e670 msgr2=0x7f6f9c14ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.044+0000 7f6f99d9b700 1 --2- 172.21.15.3:0/3215477531 >> v2:172.21.15.3:3300/0 conn(0x7f6f9c14e670 0x7f6f9c14ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.044+0000 7f6f99d9b700 1 -- 172.21.15.3:0/3215477531 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c0bd580 con 0x7f6f9c0b69e0 2023-03-06T14:16:20.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.044+0000 7f6f99d9b700 1 --2- 172.21.15.3:0/3215477531 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f9c0b69e0 0x7f6f9c0b6e30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c072b40 tx=0x7f6f8c00d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c99c8debe3e42983 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.045+0000 7f6f9959a700 1 -- 172.21.15.3:0/3215477531 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c010070 con 0x7f6f9c0b69e0 2023-03-06T14:16:20.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.045+0000 7f6f9959a700 1 -- 172.21.15.3:0/3215477531 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c00da80 con 0x7f6f9c0b69e0 2023-03-06T14:16:20.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.045+0000 7f6fa0900700 1 -- 172.21.15.3:0/3215477531 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f9c0b69e0 msgr2=0x7f6f9c0b6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.045+0000 7f6fa0900700 1 --2- 172.21.15.3:0/3215477531 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f9c0b69e0 0x7f6f9c0b6e30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c072b40 tx=0x7f6f8c00d330 comp rx=0 tx=0).stop 2023-03-06T14:16:20.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.046+0000 7f6fa0900700 1 -- 172.21.15.3:0/3215477531 shutdown_connections 2023-03-06T14:16:20.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.046+0000 7f6fa0900700 1 --2- 172.21.15.3:0/3215477531 >> v2:172.21.15.3:3300/0 conn(0x7f6f9c14e670 0x7f6f9c14ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.046+0000 7f6fa0900700 1 --2- 172.21.15.3:0/3215477531 >> v2:172.21.15.136:3300/0 conn(0x7f6f9c1488d0 0x7f6f9c0b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.046+0000 7f6fa0900700 1 --2- 172.21.15.3:0/3215477531 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f9c0b69e0 0x7f6f9c0b6e30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.046+0000 7f6fa0900700 1 -- 172.21.15.3:0/3215477531 >> 172.21.15.3:0/3215477531 conn(0x7f6f9c0c1b40 msgr2=0x7f6f9c06a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.046+0000 7f6fa0900700 1 -- 172.21.15.3:0/3215477531 shutdown_connections 2023-03-06T14:16:20.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.046+0000 7f6fa0900700 1 -- 172.21.15.3:0/3215477531 wait complete. 2023-03-06T14:16:20.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.048+0000 7f6fa0900700 1 Processor -- start 2023-03-06T14:16:20.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.048+0000 7f6fa0900700 1 -- start start 2023-03-06T14:16:20.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.049+0000 7f6fa0900700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f9c0b69e0 0x7f6f9c14cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.049+0000 7f6fa0900700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6f9c1488d0 0x7f6f9c14d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.049+0000 7f6fa0900700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f9c14e670 0x7f6f9c147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.049+0000 7f6fa0900700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c14d020 con 0x7f6f9c1488d0 2023-03-06T14:16:20.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.049+0000 7f6fa0900700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c148220 con 0x7f6f9c14e670 2023-03-06T14:16:20.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.049+0000 7f6fa0900700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c14de30 con 0x7f6f9c0b69e0 2023-03-06T14:16:20.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.050+0000 7f6f9a59c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f9c0b69e0 0x7f6f9c14cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.050+0000 7f6f9a59c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f9c0b69e0 0x7f6f9c14cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.3:49062/0 (socket says 172.21.15.3:49062) 2023-03-06T14:16:20.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.050+0000 7f6f9a59c700 1 -- 172.21.15.3:0/3243744845 learned_addr learned my addr 172.21.15.3:0/3243744845 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.050+0000 7f6f9ad9d700 1 --2- 172.21.15.3:0/3243744845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f9c14e670 0x7f6f9c147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.050+0000 7f6f9a59c700 1 -- 172.21.15.3:0/3243744845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f9c14e670 msgr2=0x7f6f9c147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.050+0000 7f6f9a59c700 1 --2- 172.21.15.3:0/3243744845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f9c14e670 0x7f6f9c147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.050+0000 7f6f9a59c700 1 -- 172.21.15.3:0/3243744845 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6f9c1488d0 msgr2=0x7f6f9c14d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.050+0000 7f6f9a59c700 1 --2- 172.21.15.3:0/3243744845 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6f9c1488d0 0x7f6f9c14d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.050+0000 7f6f9a59c700 1 -- 172.21.15.3:0/3243744845 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c0085d0 con 0x7f6f9c0b69e0 2023-03-06T14:16:20.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.049+0000 7fe5ad9c9700 1 Processor -- start 2023-03-06T14:16:20.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.049+0000 7fe5ad9c9700 1 -- start start 2023-03-06T14:16:20.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.050+0000 7fe5ad9c9700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe5a806ecb0 0x7fe5a80704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.050+0000 7fe5ad9c9700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a8153550 con 0x7fe5a8071ab0 2023-03-06T14:16:20.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.050+0000 7fe5ad9c9700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a8153810 con 0x7fe5a806e8e0 2023-03-06T14:16:20.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.050+0000 7fe5ad9c9700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a81541b0 con 0x7fe5a806ecb0 2023-03-06T14:16:20.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.050+0000 7fe5a77fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe5a8071ab0 0x7fe5a815dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58360/0 (socket says 172.21.15.3:58360) 2023-03-06T14:16:20.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.050+0000 7fe5a77fe700 1 -- 172.21.15.3:0/3609558876 learned_addr learned my addr 172.21.15.3:0/3609558876 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:20.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7fe5a67fc700 1 --2- 172.21.15.3:0/3609558876 >> v2:172.21.15.136:3300/0 conn(0x7fe5a806ecb0 0x7fe5a80704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7f6f9a59c700 1 --2- 172.21.15.3:0/3243744845 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f9c0b69e0 0x7f6f9c14cae0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6f94007f20 tx=0x7f6f9400e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7fe5a5ffb700 1 -- 172.21.15.3:0/3609558876 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029624579 0 0) 0x7fe5a8153550 con 0x7fe5a8071ab0 2023-03-06T14:16:20.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7fe5a5ffb700 1 -- 172.21.15.3:0/3609558876 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5940035b0 con 0x7fe5a8071ab0 2023-03-06T14:16:20.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7f6f8affd700 1 -- 172.21.15.3:0/3243744845 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9400ee50 con 0x7f6f9c0b69e0 2023-03-06T14:16:20.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7f6f8affd700 1 -- 172.21.15.3:0/3243744845 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f94014420 con 0x7f6f9c0b69e0 2023-03-06T14:16:20.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7f6f8affd700 1 -- 172.21.15.3:0/3243744845 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f940147d0 con 0x7f6f9c0b69e0 2023-03-06T14:16:20.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7f6fa0900700 1 -- 172.21.15.3:0/3243744845 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9c14bf00 con 0x7f6f9c0b69e0 2023-03-06T14:16:20.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7f6fa0900700 1 -- 172.21.15.3:0/3243744845 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9c14bc20 con 0x7f6f9c0b69e0 2023-03-06T14:16:20.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7fe5a5ffb700 1 -- 172.21.15.3:0/3609558876 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3376714925 0 0) 0x7fe5940035b0 con 0x7fe5a8071ab0 2023-03-06T14:16:20.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7fe5a5ffb700 1 -- 172.21.15.3:0/3609558876 >> v2:172.21.15.136:3300/0 conn(0x7fe5a806ecb0 msgr2=0x7fe5a80704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7fe5a5ffb700 1 --2- 172.21.15.3:0/3609558876 >> v2:172.21.15.136:3300/0 conn(0x7fe5a806ecb0 0x7fe5a80704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7fe5a5ffb700 1 -- 172.21.15.3:0/3609558876 >> v1:172.21.15.136:6789/0 conn(0x7fe5a806e8e0 legacy=0x7fe5a80a5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7fe5a5ffb700 1 -- 172.21.15.3:0/3609558876 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a8153af0 con 0x7fe5a8071ab0 2023-03-06T14:16:20.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7fe5a5ffb700 1 -- 172.21.15.3:0/3609558876 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3255535284 0 0) 0x7fe5a00019f0 con 0x7fe5a8071ab0 2023-03-06T14:16:20.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7fe5a5ffb700 1 -- 172.21.15.3:0/3609558876 >> v1:172.21.15.3:6789/0 conn(0x7fe5a8071ab0 legacy=0x7fe5a815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7fe5a5ffb700 1 --2- 172.21.15.3:0/3609558876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe594003a00 0x7fe594003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7fe5a5ffb700 1 --2- 172.21.15.3:0/3609558876 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe594004850 0x7fe594004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7fe5a5ffb700 1 --2- 172.21.15.3:0/3609558876 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe594005270 0x7fe59400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7fe5a5ffb700 1 -- 172.21.15.3:0/3609558876 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a81541b0 con 0x7fe594003a00 2023-03-06T14:16:20.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7fe5a5ffb700 1 -- 172.21.15.3:0/3609558876 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59400c1b0 con 0x7fe594005270 2023-03-06T14:16:20.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.051+0000 7fe5a5ffb700 1 -- 172.21.15.3:0/3609558876 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59400c370 con 0x7fe594004850 2023-03-06T14:16:20.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.052+0000 7fe5a6ffd700 1 --2- 172.21.15.3:0/3609558876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe594003a00 0x7fe594003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.053+0000 7f6f8affd700 1 -- 172.21.15.3:0/3243744845 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6f94012050 con 0x7f6f9c0b69e0 2023-03-06T14:16:20.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.054+0000 7f6f8affd700 1 --2- 172.21.15.3:0/3243744845 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f6f7c068340 0x7f6f7c06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.052+0000 7fe5a67fc700 1 --2- 172.21.15.3:0/3609558876 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe594004850 0x7fe594004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.053+0000 7fe5a6ffd700 1 -- 172.21.15.3:0/3609558876 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe594004850 msgr2=0x7fe594004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.053+0000 7fe5a6ffd700 1 --2- 172.21.15.3:0/3609558876 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe594004850 0x7fe594004cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.053+0000 7fe5a6ffd700 1 -- 172.21.15.3:0/3609558876 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe594005270 msgr2=0x7fe59400ba10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-06T14:16:20.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.053+0000 7fe5a6ffd700 1 --2- 172.21.15.3:0/3609558876 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe594005270 0x7fe59400ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.053+0000 7fe5a6ffd700 1 -- 172.21.15.3:0/3609558876 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a8153af0 con 0x7fe594003a00 2023-03-06T14:16:20.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.053+0000 7fe5a6ffd700 1 --2- 172.21.15.3:0/3609558876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe594003a00 0x7fe594003df0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe590003ed0 tx=0x7fe594005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5544c59356fcf533 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.054+0000 7f6f8affd700 1 -- 172.21.15.3:0/3243744845 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6f94086590 con 0x7f6f9c0b69e0 2023-03-06T14:16:20.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.054+0000 7fe5a77fe700 1 -- 172.21.15.3:0/3609558876 reap_dead start 2023-03-06T14:16:20.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.054+0000 7f6fa0900700 1 --2- 172.21.15.3:0/3243744845 >> [v2:172.21.15.3:6824/96681,v1:172.21.15.3:6825/96681] conn(0x7f6f9c0bc840 0x7f6f9c1ec7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.054+0000 7f6fa0900700 1 -- 172.21.15.3:0/3243744845 --> [v2:172.21.15.3:6824/96681,v1:172.21.15.3:6825/96681] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f9c1df1f0 con 0x7f6f9c0bc840 2023-03-06T14:16:20.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.054+0000 7fe5a5ffb700 1 -- 172.21.15.3:0/3609558876 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590016070 con 0x7fe594003a00 2023-03-06T14:16:20.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.055+0000 7fe5a5ffb700 1 -- 172.21.15.3:0/3609558876 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe590006860 con 0x7fe594003a00 2023-03-06T14:16:20.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.055+0000 7f6f9ad9d700 1 --2- 172.21.15.3:0/3243744845 >> [v2:172.21.15.3:6824/96681,v1:172.21.15.3:6825/96681] conn(0x7f6f9c0bc840 0x7f6f9c1ec7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.055+0000 7fe5a5ffb700 1 -- 172.21.15.3:0/3609558876 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590003970 con 0x7fe594003a00 2023-03-06T14:16:20.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.055+0000 7f7ac896e700 1 Processor -- start 2023-03-06T14:16:20.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.055+0000 7f7ac896e700 1 -- start start 2023-03-06T14:16:20.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.055+0000 7f6f99d9b700 1 --2- 172.21.15.3:0/3243744845 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f6f7c068340 0x7f6f7c06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.055+0000 7fe5ad9c9700 1 -- 172.21.15.3:0/3609558876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe594003a00 msgr2=0x7fe594003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.055+0000 7fe5ad9c9700 1 --2- 172.21.15.3:0/3609558876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe594003a00 0x7fe594003df0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe590003ed0 tx=0x7fe594005880 comp rx=0 tx=0).stop 2023-03-06T14:16:20.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.056+0000 7f6f99d9b700 1 --2- 172.21.15.3:0/3243744845 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f6f7c068340 0x7f6f7c06a7f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c1dd5d0 tx=0x7f6f8c014000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.056+0000 7fe5ad9c9700 1 -- 172.21.15.3:0/3609558876 shutdown_connections 2023-03-06T14:16:20.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.056+0000 7fe5ad9c9700 1 --2- 172.21.15.3:0/3609558876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe594003a00 0x7fe594003df0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.056+0000 7fe5ad9c9700 1 -- 172.21.15.3:0/3609558876 >> 172.21.15.3:0/3609558876 conn(0x7fe5a80c1b40 msgr2=0x7fe5a806a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.056+0000 7f6f9ad9d700 1 --2- 172.21.15.3:0/3243744845 >> [v2:172.21.15.3:6824/96681,v1:172.21.15.3:6825/96681] conn(0x7f6f9c0bc840 0x7f6f9c1ec7f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.056+0000 7fe5ad9c9700 1 -- 172.21.15.3:0/3609558876 shutdown_connections 2023-03-06T14:16:20.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.056+0000 7fe5ad9c9700 1 -- 172.21.15.3:0/3609558876 wait complete. 2023-03-06T14:16:20.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.056+0000 7f7ac896e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7ac40b69e0 0x7f7ac40b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.056+0000 7f7ac896e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac40bd330 con 0x7f7ac41539b0 2023-03-06T14:16:20.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.056+0000 7f7ac896e700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac40bbef0 con 0x7f7ac41488d0 2023-03-06T14:16:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.056+0000 7f7ac896e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac40b7610 con 0x7f7ac40b69e0 2023-03-06T14:16:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.056+0000 7f7ac2d9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f7ac41539b0 0x7f7ac4155d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58378/0 (socket says 172.21.15.3:58378) 2023-03-06T14:16:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.056+0000 7f7ac2d9d700 1 -- 172.21.15.3:0/225006197 learned_addr learned my addr 172.21.15.3:0/225006197 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.057+0000 7f7ac1d9b700 1 --2- 172.21.15.3:0/225006197 >> v2:172.21.15.3:3300/0 conn(0x7f7ac40b69e0 0x7f7ac40b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.057+0000 7f7ac159a700 1 -- 172.21.15.3:0/225006197 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344841737 0 0) 0x7f7ac40bd330 con 0x7f7ac41539b0 2023-03-06T14:16:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.057+0000 7f7ac159a700 1 -- 172.21.15.3:0/225006197 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aac0035b0 con 0x7f7ac41539b0 2023-03-06T14:16:20.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.057+0000 7f7ac1d9b700 1 -- 172.21.15.3:0/225006197 >> v1:172.21.15.136:6789/0 conn(0x7f7ac41488d0 legacy=0x7f7ac40b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.057+0000 7f7ac1d9b700 1 -- 172.21.15.3:0/225006197 >> v1:172.21.15.3:6789/0 conn(0x7f7ac41539b0 legacy=0x7f7ac4155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.057+0000 7f7ac1d9b700 1 -- 172.21.15.3:0/225006197 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac40bd580 con 0x7f7ac40b69e0 2023-03-06T14:16:20.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.057+0000 7f7ac1d9b700 1 --2- 172.21.15.3:0/225006197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ac40b69e0 0x7f7ac40b6e60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8008840 tx=0x7f7ab800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb303ffaccb3c359 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.057+0000 7f7ac159a700 1 -- 172.21.15.3:0/225006197 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8010070 con 0x7f7ac40b69e0 2023-03-06T14:16:20.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.057+0000 7f7ac159a700 1 -- 172.21.15.3:0/225006197 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab8004030 con 0x7f7ac40b69e0 2023-03-06T14:16:20.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.057+0000 7f7ac159a700 1 -- 172.21.15.3:0/225006197 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab80043c0 con 0x7f7ac40b69e0 2023-03-06T14:16:20.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.058+0000 7fe5ad9c9700 1 Processor -- start 2023-03-06T14:16:20.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.058+0000 7fe5ad9c9700 1 -- start start 2023-03-06T14:16:20.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.058+0000 7f7ac896e700 1 -- 172.21.15.3:0/225006197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ac40b69e0 msgr2=0x7f7ac40b6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.058+0000 7f7ac896e700 1 --2- 172.21.15.3:0/225006197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ac40b69e0 0x7f7ac40b6e60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8008840 tx=0x7f7ab800d330 comp rx=0 tx=0).stop 2023-03-06T14:16:20.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.059+0000 7f7ac896e700 1 -- 172.21.15.3:0/225006197 shutdown_connections 2023-03-06T14:16:20.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.059+0000 7f7ac896e700 1 --2- 172.21.15.3:0/225006197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ac40b69e0 0x7f7ac40b6e60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.059+0000 7f7ac896e700 1 -- 172.21.15.3:0/225006197 >> 172.21.15.3:0/225006197 conn(0x7f7ac40c1b40 msgr2=0x7f7ac406a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.059+0000 7f7ac896e700 1 -- 172.21.15.3:0/225006197 shutdown_connections 2023-03-06T14:16:20.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.059+0000 7fe5ad9c9700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe594003a00 0x7fe5a814ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.059+0000 7fe5ad9c9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5a8157500 0x7fe5a813c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.059+0000 7fe5ad9c9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5a813c5d0 0x7fe5a814e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.059+0000 7fe5ad9c9700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a80a60b0 con 0x7fe5a813c5d0 2023-03-06T14:16:20.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.059+0000 7fe5ad9c9700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a8154760 con 0x7fe5a8157500 2023-03-06T14:16:20.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.059+0000 7fe5ad9c9700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a8155830 con 0x7fe594003a00 2023-03-06T14:16:20.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.059+0000 7fe5a6ffd700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe594003a00 0x7fe5a814ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.059+0000 7fe5a67fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5a8157500 0x7fe5a813c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.059+0000 7fe5a6ffd700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe594003a00 0x7fe5a814ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.3:49090/0 (socket says 172.21.15.3:49090) 2023-03-06T14:16:20.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.059+0000 7fe5a6ffd700 1 -- 172.21.15.3:0/986770244 learned_addr learned my addr 172.21.15.3:0/986770244 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.059+0000 7f7ac896e700 1 -- 172.21.15.3:0/225006197 wait complete. 2023-03-06T14:16:20.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.061+0000 7f7ac896e700 1 Processor -- start 2023-03-06T14:16:20.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.061+0000 7f7ac896e700 1 -- start start 2023-03-06T14:16:20.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.060+0000 7fe5a67fc700 1 -- 172.21.15.3:0/986770244 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe594003a00 msgr2=0x7fe5a814ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.060+0000 7fe5a67fc700 1 --2- 172.21.15.3:0/986770244 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe594003a00 0x7fe5a814ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.060+0000 7fe5a67fc700 1 -- 172.21.15.3:0/986770244 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5a813c5d0 msgr2=0x7fe5a814e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.060+0000 7fe5a67fc700 1 --2- 172.21.15.3:0/986770244 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5a813c5d0 0x7fe5a814e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.060+0000 7fe5a67fc700 1 -- 172.21.15.3:0/986770244 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a8072070 con 0x7fe5a8157500 2023-03-06T14:16:20.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.060+0000 7fe5a67fc700 1 --2- 172.21.15.3:0/986770244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5a8157500 0x7fe5a813c090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe5980108c0 tx=0x7fe598010bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.060+0000 7fe59ffff700 1 -- 172.21.15.3:0/986770244 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59800e880 con 0x7fe5a8157500 2023-03-06T14:16:20.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.060+0000 7fe59ffff700 1 -- 172.21.15.3:0/986770244 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59800e9e0 con 0x7fe5a8157500 2023-03-06T14:16:20.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.061+0000 7fe59ffff700 1 -- 172.21.15.3:0/986770244 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59800ed90 con 0x7fe5a8157500 2023-03-06T14:16:20.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.058+0000 7f2dcc610700 1 Processor -- start 2023-03-06T14:16:20.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.058+0000 7f2dcc610700 1 -- start start 2023-03-06T14:16:20.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.060+0000 7f2dcc610700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2dc40b7a40 0x7f2dc40b6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.060+0000 7f2dcc610700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc406ed80 con 0x7f2dc415fc50 2023-03-06T14:16:20.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.060+0000 7f2dcc610700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc40712d0 con 0x7f2dc40b6530 2023-03-06T14:16:20.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.060+0000 7f2dcc610700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc40b7870 con 0x7f2dc40b7a40 2023-03-06T14:16:20.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.060+0000 7f2dca3ac700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f2dc40b6530 0x7f2dc4071760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.3:55874/0 (socket says 172.21.15.3:55874) 2023-03-06T14:16:20.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.060+0000 7f2dca3ac700 1 -- 172.21.15.3:0/1642854700 learned_addr learned my addr 172.21.15.3:0/1642854700 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:20.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.060+0000 7f2dc9bab700 1 --2- 172.21.15.3:0/1642854700 >> v2:172.21.15.136:3300/0 conn(0x7f2dc40b7a40 0x7f2dc40b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.061+0000 7f9710e66700 1 Processor -- start 2023-03-06T14:16:20.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.061+0000 7f9710e66700 1 -- start start 2023-03-06T14:16:20.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f6f8affd700 1 -- 172.21.15.3:0/3243744845 <== osd.1 v2:172.21.15.3:6824/96681 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6f9c1df1f0 con 0x7f6f9c0bc840 2023-03-06T14:16:20.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f7ac896e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ac40b69e0 0x7f7ac40b8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.061+0000 7fe5ad9c9700 1 -- 172.21.15.3:0/986770244 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a8153dd0 con 0x7fe5a8157500 2023-03-06T14:16:20.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f7ac896e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ac41488d0 0x7f7ac406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f7ac896e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ac41539b0 0x7f7ac4146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f7ac896e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac41ed230 con 0x7f7ac40b69e0 2023-03-06T14:16:20.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f7ac896e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac41ed760 con 0x7f7ac41488d0 2023-03-06T14:16:20.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f7ac896e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac4147820 con 0x7f7ac41539b0 2023-03-06T14:16:20.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7fe5ad9c9700 1 -- 172.21.15.3:0/986770244 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a80b7340 con 0x7fe5a8157500 2023-03-06T14:16:20.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f7ac2d9d700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ac41539b0 0x7f7ac4146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f7ac2d9d700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ac41539b0 0x7f7ac4146380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.3:49102/0 (socket says 172.21.15.3:49102) 2023-03-06T14:16:20.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f7ac2d9d700 1 -- 172.21.15.3:0/3821887158 learned_addr learned my addr 172.21.15.3:0/3821887158 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f7ac1d9b700 1 --2- 172.21.15.3:0/3821887158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ac41488d0 0x7f7ac406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.060+0000 7f2dc93aa700 1 -- 172.21.15.3:0/1642854700 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831145805 0 0) 0x7f2dc406ed80 con 0x7f2dc415fc50 2023-03-06T14:16:20.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f2dc93aa700 1 -- 172.21.15.3:0/1642854700 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2db00035b0 con 0x7f2dc415fc50 2023-03-06T14:16:20.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f2dc93aa700 1 -- 172.21.15.3:0/1642854700 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212031934 0 0) 0x7f2dc40712d0 con 0x7f2dc40b6530 2023-03-06T14:16:20.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f2dc93aa700 1 -- 172.21.15.3:0/1642854700 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dc406ed80 con 0x7f2dc40b6530 2023-03-06T14:16:20.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f2dc93aa700 1 -- 172.21.15.3:0/1642854700 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3335012405 0 0) 0x7f2db00035b0 con 0x7f2dc415fc50 2023-03-06T14:16:20.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f2dc93aa700 1 -- 172.21.15.3:0/1642854700 >> v2:172.21.15.136:3300/0 conn(0x7f2dc40b7a40 msgr2=0x7f2dc40b6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f2dc93aa700 1 --2- 172.21.15.3:0/1642854700 >> v2:172.21.15.136:3300/0 conn(0x7f2dc40b7a40 0x7f2dc40b6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f2dc93aa700 1 -- 172.21.15.3:0/1642854700 >> v1:172.21.15.136:6789/0 conn(0x7f2dc40b6530 legacy=0x7f2dc4071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f9710e66700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f970c0b6ae0 0x7f970c15fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f9710e66700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f970c071b40 0x7f970c160370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f9710e66700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970c0716b0 con 0x7f970c0b6710 2023-03-06T14:16:20.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f9710e66700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970c06ee20 con 0x7f970c071b40 2023-03-06T14:16:20.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f9710e66700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970c06eb40 con 0x7f970c0b6ae0 2023-03-06T14:16:20.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f2dc93aa700 1 -- 172.21.15.3:0/1642854700 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc40bc040 con 0x7f2dc415fc50 2023-03-06T14:16:20.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f2dc93aa700 1 -- 172.21.15.3:0/1642854700 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3255535284 0 0) 0x7f2dbc0019f0 con 0x7f2dc415fc50 2023-03-06T14:16:20.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f2dc93aa700 1 -- 172.21.15.3:0/1642854700 >> v1:172.21.15.3:6789/0 conn(0x7f2dc415fc50 legacy=0x7f2dc4160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f2dc93aa700 1 --2- 172.21.15.3:0/1642854700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2db0004c20 0x7f2db0004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f2dc93aa700 1 --2- 172.21.15.3:0/1642854700 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2db00037f0 0x7f2db0003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f2dc93aa700 1 --2- 172.21.15.3:0/1642854700 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2db00041a0 0x7f2db000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f2dc93aa700 1 -- 172.21.15.3:0/1642854700 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc0001270 con 0x7f2db00041a0 2023-03-06T14:16:20.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f2dc93aa700 1 -- 172.21.15.3:0/1642854700 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db000c030 con 0x7f2db0004c20 2023-03-06T14:16:20.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f2dc93aa700 1 -- 172.21.15.3:0/1642854700 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db000c1f0 con 0x7f2db00037f0 2023-03-06T14:16:20.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f2dca3ac700 1 --2- 172.21.15.3:0/1642854700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2db0004c20 0x7f2db0004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.062+0000 7f7ac259c700 1 --2- 172.21.15.3:0/3821887158 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ac40b69e0 0x7f7ac40b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f9709d9b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f970c0b6ae0 0x7f970c15fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f970a59c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f970c0b6710 0x7f970c06c500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.3:55890/0 (socket says 172.21.15.3:55890) 2023-03-06T14:16:20.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f970a59c700 1 -- 172.21.15.3:0/1622081919 learned_addr learned my addr 172.21.15.3:0/1622081919 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:20.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f2dcabad700 1 --2- 172.21.15.3:0/1642854700 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2db00041a0 0x7f2db000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f970ad9d700 1 --2- 172.21.15.3:0/1622081919 >> v2:172.21.15.136:3300/0 conn(0x7f970c071b40 0x7f970c160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f2dc9bab700 1 --2- 172.21.15.3:0/1642854700 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2db00037f0 0x7f2db0003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f2dcabad700 1 -- 172.21.15.3:0/1642854700 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2db00037f0 msgr2=0x7f2db0003c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f2dcabad700 1 --2- 172.21.15.3:0/1642854700 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2db00037f0 0x7f2db0003c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f2dcabad700 1 -- 172.21.15.3:0/1642854700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2db0004c20 msgr2=0x7f2db0004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f2dcabad700 1 --2- 172.21.15.3:0/1642854700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2db0004c20 0x7f2db0004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f2dcabad700 1 -- 172.21.15.3:0/1642854700 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc40bc040 con 0x7f2db00041a0 2023-03-06T14:16:20.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f2dcabad700 1 -- 172.21.15.3:0/1642854700 reap_dead start 2023-03-06T14:16:20.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f7ac259c700 1 -- 172.21.15.3:0/3821887158 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ac41539b0 msgr2=0x7f7ac4146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f7ac259c700 1 --2- 172.21.15.3:0/3821887158 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ac41539b0 0x7f7ac4146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f7ac259c700 1 -- 172.21.15.3:0/3821887158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ac41488d0 msgr2=0x7f7ac406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f7ac259c700 1 --2- 172.21.15.3:0/3821887158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ac41488d0 0x7f7ac406dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f7ac259c700 1 -- 172.21.15.3:0/3821887158 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab8008520 con 0x7f7ac40b69e0 2023-03-06T14:16:20.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f970959a700 1 -- 172.21.15.3:0/1622081919 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979780714 0 0) 0x7f970c0716b0 con 0x7f970c0b6710 2023-03-06T14:16:20.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.063+0000 7f970959a700 1 -- 172.21.15.3:0/1622081919 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96f40035b0 con 0x7f970c0b6710 2023-03-06T14:16:20.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.064+0000 7fe59dffb700 1 -- 172.21.15.3:0/986770244 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe5a81545c0 con 0x7fe5a8157500 2023-03-06T14:16:20.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.064+0000 7f2dcabad700 1 --2- 172.21.15.3:0/1642854700 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2db00041a0 0x7f2db000ba10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc002230 tx=0x7f2db0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd57d3a1eccebbb server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.064+0000 7f7ac259c700 1 --2- 172.21.15.3:0/3821887158 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ac40b69e0 0x7f7ac40b8250 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400c440 tx=0x7f7ab400c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.064+0000 7f970ad9d700 1 -- 172.21.15.3:0/1622081919 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f970c0b6ae0 msgr2=0x7f970c15fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.064+0000 7f970ad9d700 1 --2- 172.21.15.3:0/1622081919 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f970c0b6ae0 0x7f970c15fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.064+0000 7f970ad9d700 1 -- 172.21.15.3:0/1622081919 >> v1:172.21.15.136:6789/0 conn(0x7f970c0b6710 legacy=0x7f970c06c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.064+0000 7f970ad9d700 1 -- 172.21.15.3:0/1622081919 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c071060 con 0x7f970c071b40 2023-03-06T14:16:20.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.064+0000 7f31778e2700 1 Processor -- start 2023-03-06T14:16:20.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.064+0000 7f7ab2ffd700 1 -- 172.21.15.3:0/3821887158 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab40052d0 con 0x7f7ac40b69e0 2023-03-06T14:16:20.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.064+0000 7f7ab2ffd700 1 -- 172.21.15.3:0/3821887158 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab4005430 con 0x7f7ac40b69e0 2023-03-06T14:16:20.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.064+0000 7f7ab2ffd700 1 -- 172.21.15.3:0/3821887158 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab40038c0 con 0x7f7ac40b69e0 2023-03-06T14:16:20.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.064+0000 7f7ac896e700 1 -- 172.21.15.3:0/3821887158 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac414bf00 con 0x7f7ac40b69e0 2023-03-06T14:16:20.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.064+0000 7f7ac896e700 1 -- 172.21.15.3:0/3821887158 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac414bc20 con 0x7f7ac40b69e0 2023-03-06T14:16:20.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.065+0000 7f970ad9d700 1 --2- 172.21.15.3:0/1622081919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f970c071b40 0x7f970c160370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9704009d90 tx=0x7f970400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a856e2d31f3243db server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.064+0000 7f2dc93aa700 1 -- 172.21.15.3:0/1642854700 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc012620 con 0x7f2db00041a0 2023-03-06T14:16:20.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.064+0000 7f2dc93aa700 1 -- 172.21.15.3:0/1642854700 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc012780 con 0x7f2db00041a0 2023-03-06T14:16:20.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.064+0000 7f2dc93aa700 1 -- 172.21.15.3:0/1642854700 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc012b30 con 0x7f2db00041a0 2023-03-06T14:16:20.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.065+0000 7f2dcc610700 1 -- 172.21.15.3:0/1642854700 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2db00041a0 msgr2=0x7f2db000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.065+0000 7f2dcc610700 1 --2- 172.21.15.3:0/1642854700 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2db00041a0 0x7f2db000ba10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc002230 tx=0x7f2db0005880 comp rx=0 tx=0).stop 2023-03-06T14:16:20.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.065+0000 7f2dcc610700 1 -- 172.21.15.3:0/1642854700 shutdown_connections 2023-03-06T14:16:20.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.065+0000 7f2dcc610700 1 --2- 172.21.15.3:0/1642854700 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2db00041a0 0x7f2db000ba10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.065+0000 7f2dcc610700 1 -- 172.21.15.3:0/1642854700 >> 172.21.15.3:0/1642854700 conn(0x7f2dc40c1b40 msgr2=0x7f2dc406a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.064+0000 7f31778e2700 1 -- start start 2023-03-06T14:16:20.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.065+0000 7f31778e2700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f31700b69e0 0x7f31700b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.065+0000 7f31778e2700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f31701539b0 0x7f3170155d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.065+0000 7f31778e2700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31700bd330 con 0x7f31701488d0 2023-03-06T14:16:20.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.065+0000 7f31778e2700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31700b7610 con 0x7f31700b69e0 2023-03-06T14:16:20.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.065+0000 7f31778e2700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31700bbef0 con 0x7f31701539b0 2023-03-06T14:16:20.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.065+0000 7f970959a700 1 -- 172.21.15.3:0/1622081919 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970400bce0 con 0x7f970c071b40 2023-03-06T14:16:20.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.066+0000 7f970959a700 1 -- 172.21.15.3:0/1622081919 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970400be40 con 0x7f970c071b40 2023-03-06T14:16:20.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.066+0000 7f970959a700 1 -- 172.21.15.3:0/1622081919 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9704003c60 con 0x7f970c071b40 2023-03-06T14:16:20.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.066+0000 7f3175e7f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f31701539b0 0x7f3170155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.066+0000 7f3175e7f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f31701539b0 0x7f3170155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.3:49122/0 (socket says 172.21.15.3:49122) 2023-03-06T14:16:20.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.066+0000 7f3175e7f700 1 -- 172.21.15.3:0/3820764590 learned_addr learned my addr 172.21.15.3:0/3820764590 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.066+0000 7f3174e7d700 1 --2- 172.21.15.3:0/3820764590 >> v2:172.21.15.3:3300/0 conn(0x7f31700b69e0 0x7f31700b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.066+0000 7f3175e7f700 1 -- 172.21.15.3:0/3820764590 >> v2:172.21.15.3:3300/0 conn(0x7f31700b69e0 msgr2=0x7f31700b6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.066+0000 7f3175e7f700 1 --2- 172.21.15.3:0/3820764590 >> v2:172.21.15.3:3300/0 conn(0x7f31700b69e0 0x7f31700b6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.066+0000 7f3175e7f700 1 -- 172.21.15.3:0/3820764590 >> v1:172.21.15.3:6789/0 conn(0x7f31701488d0 legacy=0x7f31700b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.066+0000 7f3175e7f700 1 -- 172.21.15.3:0/3820764590 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31700bd580 con 0x7f31701539b0 2023-03-06T14:16:20.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.067+0000 7f3175e7f700 1 --2- 172.21.15.3:0/3820764590 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f31701539b0 0x7f3170155d90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f316800d1e0 tx=0x7f316800d4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4f428c21f72cb10 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.067+0000 7f9710e66700 1 -- 172.21.15.3:0/1622081919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f970c071b40 msgr2=0x7f970c160370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.067+0000 7f9710e66700 1 --2- 172.21.15.3:0/1622081919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f970c071b40 0x7f970c160370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9704009d90 tx=0x7f970400b330 comp rx=0 tx=0).stop 2023-03-06T14:16:20.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.067+0000 7f9710e66700 1 -- 172.21.15.3:0/1622081919 shutdown_connections 2023-03-06T14:16:20.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.067+0000 7f9710e66700 1 --2- 172.21.15.3:0/1622081919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f970c071b40 0x7f970c160370 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.067+0000 7f9710e66700 1 --2- 172.21.15.3:0/1622081919 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f970c0b6ae0 0x7f970c15fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.067+0000 7f9710e66700 1 -- 172.21.15.3:0/1622081919 >> 172.21.15.3:0/1622081919 conn(0x7f970c0c1b40 msgr2=0x7f970c06a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.067+0000 7f9710e66700 1 -- 172.21.15.3:0/1622081919 shutdown_connections 2023-03-06T14:16:20.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.067+0000 7f9710e66700 1 -- 172.21.15.3:0/1622081919 wait complete. 2023-03-06T14:16:20.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.067+0000 7fe59ffff700 1 -- 172.21.15.3:0/986770244 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe598012040 con 0x7fe5a8157500 2023-03-06T14:16:20.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.067+0000 7fe59ffff700 1 --2- 172.21.15.3:0/986770244 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fe5880682f0 0x7fe58806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.067+0000 7fe59ffff700 1 -- 172.21.15.3:0/986770244 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe598086180 con 0x7fe5a8157500 2023-03-06T14:16:20.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.067+0000 7fe5a6ffd700 1 --2- 172.21.15.3:0/986770244 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fe5880682f0 0x7fe58806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.068+0000 7fe59ffff700 1 --2- 172.21.15.3:0/986770244 >> [v2:172.21.15.136:6820/96798,v1:172.21.15.136:6822/96798] conn(0x7fe588071fc0 0x7fe5880743f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.068+0000 7fe59ffff700 1 -- 172.21.15.3:0/986770244 --> [v2:172.21.15.136:6820/96798,v1:172.21.15.136:6822/96798] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe588074ac0 con 0x7fe588071fc0 2023-03-06T14:16:20.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.068+0000 7fe59ffff700 1 -- 172.21.15.3:0/986770244 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe598088740 con 0x7fe5a8157500 2023-03-06T14:16:20.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.068+0000 7f7ab2ffd700 1 -- 172.21.15.3:0/3821887158 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7ab4019030 con 0x7f7ac40b69e0 2023-03-06T14:16:20.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.068+0000 7fe5a77fe700 1 --2- 172.21.15.3:0/986770244 >> [v2:172.21.15.136:6820/96798,v1:172.21.15.136:6822/96798] conn(0x7fe588071fc0 0x7fe5880743f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.068+0000 7f2dcc610700 1 -- 172.21.15.3:0/1642854700 shutdown_connections 2023-03-06T14:16:20.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.068+0000 7fe5a6ffd700 1 --2- 172.21.15.3:0/986770244 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fe5880682f0 0x7fe58806a7a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe590014040 tx=0x7fe590009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.068+0000 7f7ac896e700 1 -- 172.21.15.3:0/3821887158 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ac406c390 con 0x7f7ac40b69e0 2023-03-06T14:16:20.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.068+0000 7f7ab2ffd700 1 --2- 172.21.15.3:0/3821887158 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f7aa40683c0 0x7f7aa406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.068+0000 7fe5a77fe700 1 --2- 172.21.15.3:0/986770244 >> [v2:172.21.15.136:6820/96798,v1:172.21.15.136:6822/96798] conn(0x7fe588071fc0 0x7fe5880743f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.068+0000 7f7ab2ffd700 1 -- 172.21.15.3:0/3821887158 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7ab4085210 con 0x7f7ac40b69e0 2023-03-06T14:16:20.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.069+0000 7f7ac1d9b700 1 --2- 172.21.15.3:0/3821887158 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f7aa40683c0 0x7f7aa406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.069+0000 7f7ab2ffd700 1 --2- 172.21.15.3:0/3821887158 >> [v2:172.21.15.3:6813/96682,v1:172.21.15.3:6815/96682] conn(0x7f7aa4072010 0x7f7aa4074440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.069+0000 7f7ab2ffd700 1 -- 172.21.15.3:0/3821887158 --> [v2:172.21.15.3:6813/96682,v1:172.21.15.3:6815/96682] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7aa4074b10 con 0x7f7aa4072010 2023-03-06T14:16:20.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.069+0000 7f7ab2ffd700 1 -- 172.21.15.3:0/3821887158 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ab4051710 con 0x7f7ac40b69e0 2023-03-06T14:16:20.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.069+0000 7f7ac2d9d700 1 --2- 172.21.15.3:0/3821887158 >> [v2:172.21.15.3:6813/96682,v1:172.21.15.3:6815/96682] conn(0x7f7aa4072010 0x7f7aa4074440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.069+0000 7f9710e66700 1 Processor -- start 2023-03-06T14:16:20.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.069+0000 7f0fc2680700 1 Processor -- start 2023-03-06T14:16:20.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.069+0000 7f7ac1d9b700 1 --2- 172.21.15.3:0/3821887158 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f7aa40683c0 0x7f7aa406a870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8019040 tx=0x7f7ab8012000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.069+0000 7fe59ffff700 1 -- 172.21.15.3:0/986770244 <== osd.4 v2:172.21.15.136:6820/96798 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe588074ac0 con 0x7fe588071fc0 2023-03-06T14:16:20.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.070+0000 7f7ac2d9d700 1 --2- 172.21.15.3:0/3821887158 >> [v2:172.21.15.3:6813/96682,v1:172.21.15.3:6815/96682] conn(0x7f7aa4072010 0x7f7aa4074440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.069+0000 7f9710e66700 1 -- start start 2023-03-06T14:16:20.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.070+0000 7f9710e66700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f970c071b40 0x7f970c088c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.070+0000 7f9710e66700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f970c0b6710 0x7f970c0c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.070+0000 7f9710e66700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f970c0b6ae0 0x7f970c0bf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.070+0000 7f9710e66700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c1f4c10 con 0x7f970c0b6ae0 2023-03-06T14:16:20.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.070+0000 7f9710e66700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c0891a0 con 0x7f970c0b6710 2023-03-06T14:16:20.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.070+0000 7f9710e66700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970c0bed90 con 0x7f970c071b40 2023-03-06T14:16:20.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.069+0000 7f0fc2680700 1 -- start start 2023-03-06T14:16:20.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.070+0000 7f0fc2680700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0fbc1488d0 0x7f0fbc0b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.070+0000 7f0fc2680700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0fbc0b69e0 0x7f0fbc0b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.070+0000 7f0fc2680700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0fbc14e670 0x7f0fbc14ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.070+0000 7f0fc2680700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fbc0b7610 con 0x7f0fbc1488d0 2023-03-06T14:16:20.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.070+0000 7f0fc2680700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fbc0bd330 con 0x7f0fbc14e670 2023-03-06T14:16:20.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.070+0000 7f0fc2680700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc0bbef0 con 0x7f0fbc0b69e0 2023-03-06T14:16:20.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.068+0000 7f2dcc610700 1 -- 172.21.15.3:0/1642854700 wait complete. 2023-03-06T14:16:20.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.070+0000 7f2dcc610700 1 Processor -- start 2023-03-06T14:16:20.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f0fc0c1d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0fbc14e670 0x7f0fbc14ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f9709d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f970c0b6710 0x7f970c0c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f970a59c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f970c071b40 0x7f970c088c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f970ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f970c0b6ae0 0x7f970c0bf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f970ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f970c0b6ae0 0x7f970c0bf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56158/0 (socket says 172.21.15.3:56158) 2023-03-06T14:16:20.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f970ad9d700 1 -- 172.21.15.3:0/1644793862 learned_addr learned my addr 172.21.15.3:0/1644793862 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f0fc0c1d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0fbc14e670 0x7f0fbc14ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.3:42250/0 (socket says 172.21.15.3:42250) 2023-03-06T14:16:20.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f0fc0c1d700 1 -- 172.21.15.3:0/3821155294 learned_addr learned my addr 172.21.15.3:0/3821155294 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f7ab2ffd700 1 -- 172.21.15.3:0/3821887158 <== osd.2 v2:172.21.15.3:6813/96682 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7aa4074b10 con 0x7f7aa4072010 2023-03-06T14:16:20.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f970a59c700 1 -- 172.21.15.3:0/1644793862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f970c0b6710 msgr2=0x7f970c0c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f970a59c700 1 --2- 172.21.15.3:0/1644793862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f970c0b6710 0x7f970c0c06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f970a59c700 1 -- 172.21.15.3:0/1644793862 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f970c0b6ae0 msgr2=0x7f970c0bf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f970a59c700 1 --2- 172.21.15.3:0/1644793862 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f970c0b6ae0 0x7f970c0bf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f970a59c700 1 -- 172.21.15.3:0/1644793862 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9704009a70 con 0x7f970c071b40 2023-03-06T14:16:20.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f0fbb7fe700 1 --2- 172.21.15.3:0/3821155294 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0fbc0b69e0 0x7f0fbc0b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f0fc0c1d700 1 -- 172.21.15.3:0/3821155294 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0fbc0b69e0 msgr2=0x7f0fbc0b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f0fc0c1d700 1 --2- 172.21.15.3:0/3821155294 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0fbc0b69e0 0x7f0fbc0b6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f0fc0c1d700 1 -- 172.21.15.3:0/3821155294 >> v2:172.21.15.3:3300/0 conn(0x7f0fbc1488d0 msgr2=0x7f0fbc0b5eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-06T14:16:20.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f0fc0c1d700 1 --2- 172.21.15.3:0/3821155294 >> v2:172.21.15.3:3300/0 conn(0x7f0fbc1488d0 0x7f0fbc0b5eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f0fc0c1d700 1 -- 172.21.15.3:0/3821155294 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc0bd580 con 0x7f0fbc14e670 2023-03-06T14:16:20.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f0fc0c1d700 1 --2- 172.21.15.3:0/3821155294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fbc14e670 0x7f0fbc14ead0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc06c250 tx=0x7f0fb00095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55bbf3d7761d2155 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f0fbaffd700 1 -- 172.21.15.3:0/3821155294 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000c980 con 0x7f0fbc14e670 2023-03-06T14:16:20.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f0fbaffd700 1 -- 172.21.15.3:0/3821155294 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb000cae0 con 0x7f0fbc14e670 2023-03-06T14:16:20.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f0fbaffd700 1 -- 172.21.15.3:0/3821155294 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000ce70 con 0x7f0fbc14e670 2023-03-06T14:16:20.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.070+0000 7f2dcc610700 1 -- start start 2023-03-06T14:16:20.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f2dcc610700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2db00041a0 0x7f2dc415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f2dcc610700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dc41e5040 0x7f2dc41e54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f2dcc610700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dc41e6ca0 0x7f2dc41e7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f2dcc610700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc415da00 con 0x7f2db00041a0 2023-03-06T14:16:20.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f2dcc610700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc41e59f0 con 0x7f2dc41e5040 2023-03-06T14:16:20.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f2dcc610700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc41fa420 con 0x7f2dc41e6ca0 2023-03-06T14:16:20.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.071+0000 7f2dc9bab700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dc41e5040 0x7f2dc41e54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f2dc9bab700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dc41e5040 0x7f2dc41e54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.3:42254/0 (socket says 172.21.15.3:42254) 2023-03-06T14:16:20.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f2dc9bab700 1 -- 172.21.15.3:0/2866139373 learned_addr learned my addr 172.21.15.3:0/2866139373 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f2dcabad700 1 --2- 172.21.15.3:0/2866139373 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dc41e6ca0 0x7f2dc41e7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f2dca3ac700 1 --2- 172.21.15.3:0/2866139373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2db00041a0 0x7f2dc415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f970a59c700 1 --2- 172.21.15.3:0/1644793862 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f970c071b40 0x7f970c088c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00c4a0 tx=0x7f96fc00c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f2dc9bab700 1 -- 172.21.15.3:0/2866139373 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dc41e6ca0 msgr2=0x7f2dc41e7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f2dc9bab700 1 --2- 172.21.15.3:0/2866139373 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dc41e6ca0 0x7f2dc41e7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f2dc9bab700 1 -- 172.21.15.3:0/2866139373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2db00041a0 msgr2=0x7f2dc415d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f2dc9bab700 1 --2- 172.21.15.3:0/2866139373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2db00041a0 0x7f2dc415d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f2dc9bab700 1 -- 172.21.15.3:0/2866139373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc4070f60 con 0x7f2dc41e5040 2023-03-06T14:16:20.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.072+0000 7f2dc9bab700 1 --2- 172.21.15.3:0/2866139373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dc41e5040 0x7f2dc41e54b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2db400f970 tx=0x7f2db400fc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.073+0000 7f96faffd700 1 -- 172.21.15.3:0/1644793862 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc004c80 con 0x7f970c071b40 2023-03-06T14:16:20.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.073+0000 7f96faffd700 1 -- 172.21.15.3:0/1644793862 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96fc004de0 con 0x7f970c071b40 2023-03-06T14:16:20.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.073+0000 7f96faffd700 1 -- 172.21.15.3:0/1644793862 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc007310 con 0x7f970c071b40 2023-03-06T14:16:20.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.073+0000 7f2dbaffd700 1 -- 172.21.15.3:0/2866139373 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4014760 con 0x7f2dc41e5040 2023-03-06T14:16:20.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.073+0000 7f2dbaffd700 1 -- 172.21.15.3:0/2866139373 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db4011040 con 0x7f2dc41e5040 2023-03-06T14:16:20.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.073+0000 7f2dbaffd700 1 -- 172.21.15.3:0/2866139373 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4014b00 con 0x7f2dc41e5040 2023-03-06T14:16:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.073+0000 7f9710e66700 1 -- 172.21.15.3:0/1644793862 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970c0b7a40 con 0x7f970c071b40 2023-03-06T14:16:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.073+0000 7f9710e66700 1 -- 172.21.15.3:0/1644793862 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970c071340 con 0x7f970c071b40 2023-03-06T14:16:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.073+0000 7f2dcc610700 1 -- 172.21.15.3:0/2866139373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc406eaa0 con 0x7f2dc41e5040 2023-03-06T14:16:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.073+0000 7f2dcc610700 1 -- 172.21.15.3:0/2866139373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc40bba20 con 0x7f2dc41e5040 2023-03-06T14:16:20.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.073+0000 7f0fc2680700 1 -- 172.21.15.3:0/3821155294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fbc14e670 msgr2=0x7f0fbc14ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.073+0000 7f0fc2680700 1 --2- 172.21.15.3:0/3821155294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fbc14e670 0x7f0fbc14ead0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc06c250 tx=0x7f0fb00095c0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.075+0000 7f96faffd700 1 -- 172.21.15.3:0/1644793862 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f96fc01a020 con 0x7f970c071b40 2023-03-06T14:16:20.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.075+0000 7f2dcc610700 1 -- 172.21.15.3:0/2866139373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2dc404e6e0 con 0x7f2dc41e5040 2023-03-06T14:16:20.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.075+0000 7f0fc2680700 1 -- 172.21.15.3:0/3821155294 shutdown_connections 2023-03-06T14:16:20.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.075+0000 7f0fc2680700 1 --2- 172.21.15.3:0/3821155294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fbc14e670 0x7f0fbc14ead0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.075+0000 7f0fc2680700 1 --2- 172.21.15.3:0/3821155294 >> v2:172.21.15.3:3300/0 conn(0x7f0fbc1488d0 0x7f0fbc0b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.075+0000 7f0fc2680700 1 --2- 172.21.15.3:0/3821155294 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0fbc0b69e0 0x7f0fbc0b6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.075+0000 7f0fc2680700 1 -- 172.21.15.3:0/3821155294 >> 172.21.15.3:0/3821155294 conn(0x7f0fbc0c1b40 msgr2=0x7f0fbc06a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.075+0000 7f0fc2680700 1 -- 172.21.15.3:0/3821155294 shutdown_connections 2023-03-06T14:16:20.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.075+0000 7f0fc2680700 1 -- 172.21.15.3:0/3821155294 wait complete. 2023-03-06T14:16:20.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.076+0000 7f96faffd700 1 --2- 172.21.15.3:0/1644793862 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f96ec068340 0x7f96ec06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.076+0000 7f96faffd700 1 -- 172.21.15.3:0/1644793862 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f96fc085860 con 0x7f970c071b40 2023-03-06T14:16:20.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.076+0000 7f9710e66700 1 --2- 172.21.15.3:0/1644793862 >> [v2:172.21.15.3:6800/96680,v1:172.21.15.3:6801/96680] conn(0x7f96f00015d0 0x7f96f0003a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.076+0000 7f9710e66700 1 -- 172.21.15.3:0/1644793862 --> [v2:172.21.15.3:6800/96680,v1:172.21.15.3:6801/96680] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f96f0006bb0 con 0x7f96f00015d0 2023-03-06T14:16:20.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.076+0000 7f9709d9b700 1 --2- 172.21.15.3:0/1644793862 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f96ec068340 0x7f96ec06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.076+0000 7f3167fff700 1 -- 172.21.15.3:0/3820764590 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3168010070 con 0x7f31701539b0 2023-03-06T14:16:20.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.076+0000 7f3167fff700 1 -- 172.21.15.3:0/3820764590 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316800dca0 con 0x7f31701539b0 2023-03-06T14:16:20.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.076+0000 7f3167fff700 1 -- 172.21.15.3:0/3820764590 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3168007d80 con 0x7f31701539b0 2023-03-06T14:16:20.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.077+0000 7f9709d9b700 1 --2- 172.21.15.3:0/1644793862 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f96ec068340 0x7f96ec06a7f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f970c06a960 tx=0x7f970000c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.077+0000 7f0fc2680700 1 Processor -- start 2023-03-06T14:16:20.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.075+0000 7f2dbaffd700 1 -- 172.21.15.3:0/2866139373 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2db401e030 con 0x7f2dc41e5040 2023-03-06T14:16:20.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.076+0000 7f2dbaffd700 1 --2- 172.21.15.3:0/2866139373 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f2da80682e0 0x7f2da806a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.076+0000 7f2dbaffd700 1 -- 172.21.15.3:0/2866139373 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2db4085750 con 0x7f2dc41e5040 2023-03-06T14:16:20.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.076+0000 7f2dbaffd700 1 --2- 172.21.15.3:0/2866139373 >> [v2:172.21.15.136:6816/96819,v1:172.21.15.136:6817/96819] conn(0x7f2da8071fb0 0x7f2da80743e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.076+0000 7f2dbaffd700 1 -- 172.21.15.3:0/2866139373 --> [v2:172.21.15.136:6816/96819,v1:172.21.15.136:6817/96819] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2da8074ab0 con 0x7f2da8071fb0 2023-03-06T14:16:20.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.076+0000 7f2dbaffd700 1 -- 172.21.15.3:0/2866139373 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2db4087d70 con 0x7f2dc41e5040 2023-03-06T14:16:20.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.077+0000 7f2dcabad700 1 --2- 172.21.15.3:0/2866139373 >> [v2:172.21.15.136:6816/96819,v1:172.21.15.136:6817/96819] conn(0x7f2da8071fb0 0x7f2da80743e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.077+0000 7f2dcabad700 1 --2- 172.21.15.3:0/2866139373 >> [v2:172.21.15.136:6816/96819,v1:172.21.15.136:6817/96819] conn(0x7f2da8071fb0 0x7f2da80743e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.077+0000 7f0fc2680700 1 -- start start 2023-03-06T14:16:20.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.078+0000 7f970ad9d700 1 --2- 172.21.15.3:0/1644793862 >> [v2:172.21.15.3:6800/96680,v1:172.21.15.3:6801/96680] conn(0x7f96f00015d0 0x7f96f0003a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.078+0000 7f2dca3ac700 1 --2- 172.21.15.3:0/2866139373 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f2da80682e0 0x7f2da806a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.077+0000 7f31778e2700 1 -- 172.21.15.3:0/3820764590 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f31701539b0 msgr2=0x7f3170155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.077+0000 7f31778e2700 1 --2- 172.21.15.3:0/3820764590 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f31701539b0 0x7f3170155d90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f316800d1e0 tx=0x7f316800d4f0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.078+0000 7f2dbaffd700 1 -- 172.21.15.3:0/2866139373 <== osd.7 v2:172.21.15.136:6816/96819 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2da8074ab0 con 0x7f2da8071fb0 2023-03-06T14:16:20.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.078+0000 7f31778e2700 1 -- 172.21.15.3:0/3820764590 shutdown_connections 2023-03-06T14:16:20.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.078+0000 7f31778e2700 1 --2- 172.21.15.3:0/3820764590 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f31701539b0 0x7f3170155d90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.078+0000 7f31778e2700 1 --2- 172.21.15.3:0/3820764590 >> v2:172.21.15.3:3300/0 conn(0x7f31700b69e0 0x7f31700b6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.078+0000 7f31778e2700 1 -- 172.21.15.3:0/3820764590 >> 172.21.15.3:0/3820764590 conn(0x7f31700c1b40 msgr2=0x7f317006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.078+0000 7f31778e2700 1 -- 172.21.15.3:0/3820764590 shutdown_connections 2023-03-06T14:16:20.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.079+0000 7f0fc2680700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0fbc0b69e0 0x7f0fbc141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.079+0000 7f0fc2680700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0fbc1488d0 0x7f0fbc14cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.079+0000 7f0fc2680700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fbc14e670 0x7f0fbc06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.079+0000 7f0fc2680700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc1e2550 con 0x7f0fbc0b69e0 2023-03-06T14:16:20.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.079+0000 7f0fc2680700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc147ee0 con 0x7f0fbc14e670 2023-03-06T14:16:20.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.079+0000 7f0fc2680700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc14e1b0 con 0x7f0fbc1488d0 2023-03-06T14:16:20.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.079+0000 7f0fbb7fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0fbc1488d0 0x7f0fbc14cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.079+0000 7f0fbb7fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0fbc1488d0 0x7f0fbc14cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.3:49162/0 (socket says 172.21.15.3:49162) 2023-03-06T14:16:20.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.079+0000 7f0fbb7fe700 1 -- 172.21.15.3:0/3684559497 learned_addr learned my addr 172.21.15.3:0/3684559497 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.079+0000 7f0fbbfff700 1 --2- 172.21.15.3:0/3684559497 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0fbc0b69e0 0x7f0fbc141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.080+0000 7f0fbbfff700 1 -- 172.21.15.3:0/3684559497 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0fbc1488d0 msgr2=0x7f0fbc14cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.080+0000 7f0fbbfff700 1 --2- 172.21.15.3:0/3684559497 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0fbc1488d0 0x7f0fbc14cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.080+0000 7f0fbbfff700 1 -- 172.21.15.3:0/3684559497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fbc14e670 msgr2=0x7f0fbc06d8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-06T14:16:20.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.080+0000 7f0fbbfff700 1 --2- 172.21.15.3:0/3684559497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fbc14e670 0x7f0fbc06d8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.080+0000 7f0fbbfff700 1 -- 172.21.15.3:0/3684559497 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb0009de0 con 0x7f0fbc0b69e0 2023-03-06T14:16:20.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.080+0000 7f0fbbfff700 1 --2- 172.21.15.3:0/3684559497 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0fbc0b69e0 0x7f0fbc141ce0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400bd50 tx=0x7f0fb400bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.078+0000 7f31778e2700 1 -- 172.21.15.3:0/3820764590 wait complete. 2023-03-06T14:16:20.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.080+0000 7f31778e2700 1 Processor -- start 2023-03-06T14:16:20.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.080+0000 7f31778e2700 1 -- start start 2023-03-06T14:16:20.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.081+0000 7f31778e2700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f31700b69e0 0x7f31700bff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.081+0000 7f31778e2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31701488d0 0x7f317006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.081+0000 7f31778e2700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31701539b0 0x7f3170140700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.081+0000 7f31778e2700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31700b90e0 con 0x7f31701539b0 2023-03-06T14:16:20.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.081+0000 7f31778e2700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317006d940 con 0x7f31701488d0 2023-03-06T14:16:20.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.081+0000 7f31778e2700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3170206aa0 con 0x7f31700b69e0 2023-03-06T14:16:20.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.080+0000 7f0fb8ff9700 1 -- 172.21.15.3:0/3684559497 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb400cc90 con 0x7f0fbc0b69e0 2023-03-06T14:16:20.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.080+0000 7f0fc2680700 1 -- 172.21.15.3:0/3684559497 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fbc14bf00 con 0x7f0fbc0b69e0 2023-03-06T14:16:20.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.080+0000 7f0fc2680700 1 -- 172.21.15.3:0/3684559497 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fbc14bc20 con 0x7f0fbc0b69e0 2023-03-06T14:16:20.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.080+0000 7f0fb8ff9700 1 -- 172.21.15.3:0/3684559497 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb400ce10 con 0x7f0fbc0b69e0 2023-03-06T14:16:20.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.080+0000 7f0fb8ff9700 1 -- 172.21.15.3:0/3684559497 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4014680 con 0x7f0fbc0b69e0 2023-03-06T14:16:20.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.081+0000 7f3175e7f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31701539b0 0x7f3170140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.081+0000 7f3175e7f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31701539b0 0x7f3170140700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56188/0 (socket says 172.21.15.3:56188) 2023-03-06T14:16:20.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.081+0000 7f3175e7f700 1 -- 172.21.15.3:0/1699750625 learned_addr learned my addr 172.21.15.3:0/1699750625 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.082+0000 7f3174e7d700 1 --2- 172.21.15.3:0/1699750625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31701488d0 0x7f317006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.082+0000 7f317567e700 1 --2- 172.21.15.3:0/1699750625 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f31700b69e0 0x7f31700bff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.082+0000 7f3175e7f700 1 -- 172.21.15.3:0/1699750625 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f31700b69e0 msgr2=0x7f31700bff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.082+0000 7f3175e7f700 1 --2- 172.21.15.3:0/1699750625 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f31700b69e0 0x7f31700bff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.082+0000 7f3175e7f700 1 -- 172.21.15.3:0/1699750625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31701488d0 msgr2=0x7f317006d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.082+0000 7f3175e7f700 1 --2- 172.21.15.3:0/1699750625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31701488d0 0x7f317006d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.082+0000 7f3175e7f700 1 -- 172.21.15.3:0/1699750625 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31680079d0 con 0x7f31701539b0 2023-03-06T14:16:20.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.082+0000 7f3175e7f700 1 --2- 172.21.15.3:0/1699750625 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31701539b0 0x7f3170140700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f31700bc030 tx=0x7f3168004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.082+0000 7f0fc2680700 1 -- 172.21.15.3:0/3684559497 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f98000fb0 con 0x7f0fbc0b69e0 2023-03-06T14:16:20.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.083+0000 7f3165ffb700 1 -- 172.21.15.3:0/1699750625 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3168004240 con 0x7f31701539b0 2023-03-06T14:16:20.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.083+0000 7f3165ffb700 1 -- 172.21.15.3:0/1699750625 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31680043c0 con 0x7f31701539b0 2023-03-06T14:16:20.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.083+0000 7f31778e2700 1 -- 172.21.15.3:0/1699750625 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317014bf00 con 0x7f31701539b0 2023-03-06T14:16:20.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.083+0000 7f31778e2700 1 -- 172.21.15.3:0/1699750625 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317014bc20 con 0x7f31701539b0 2023-03-06T14:16:20.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.083+0000 7f3165ffb700 1 -- 172.21.15.3:0/1699750625 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3168004770 con 0x7f31701539b0 2023-03-06T14:16:20.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.084+0000 7f31778e2700 1 -- 172.21.15.3:0/1699750625 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3150000fb0 con 0x7f31701539b0 2023-03-06T14:16:20.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.084+0000 7f0fb8ff9700 1 -- 172.21.15.3:0/3684559497 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0fb401b030 con 0x7f0fbc0b69e0 2023-03-06T14:16:20.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.084+0000 7f0fb8ff9700 1 --2- 172.21.15.3:0/3684559497 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0fa00682c0 0x7f0fa006a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.084+0000 7f0fb8ff9700 1 -- 172.21.15.3:0/3684559497 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0fb4086550 con 0x7f0fbc0b69e0 2023-03-06T14:16:20.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.085+0000 7f0fbb7fe700 1 --2- 172.21.15.3:0/3684559497 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0fa00682c0 0x7f0fa006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.085+0000 7f0fb8ff9700 1 --2- 172.21.15.3:0/3684559497 >> [v2:172.21.15.136:6802/96796,v1:172.21.15.136:6804/96796] conn(0x7f0fa0071f90 0x7f0fa00743c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.085+0000 7f0fb8ff9700 1 -- 172.21.15.3:0/3684559497 --> [v2:172.21.15.136:6802/96796,v1:172.21.15.136:6804/96796] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0fa0074a90 con 0x7f0fa0071f90 2023-03-06T14:16:20.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.085+0000 7f0fb8ff9700 1 -- 172.21.15.3:0/3684559497 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fb4086900 con 0x7f0fbc0b69e0 2023-03-06T14:16:20.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.085+0000 7f0fc0c1d700 1 --2- 172.21.15.3:0/3684559497 >> [v2:172.21.15.136:6802/96796,v1:172.21.15.136:6804/96796] conn(0x7f0fa0071f90 0x7f0fa00743c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.085+0000 7f0fbb7fe700 1 --2- 172.21.15.3:0/3684559497 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0fa00682c0 0x7f0fa006a770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc1472b0 tx=0x7f0fac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.085+0000 7f0fc0c1d700 1 --2- 172.21.15.3:0/3684559497 >> [v2:172.21.15.136:6802/96796,v1:172.21.15.136:6804/96796] conn(0x7f0fa0071f90 0x7f0fa00743c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.086+0000 7f0fb8ff9700 1 -- 172.21.15.3:0/3684559497 <== osd.5 v2:172.21.15.136:6802/96796 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0fa0074a90 con 0x7f0fa0071f90 2023-03-06T14:16:20.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.087+0000 7f3165ffb700 1 -- 172.21.15.3:0/1699750625 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3168026030 con 0x7f31701539b0 2023-03-06T14:16:20.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.087+0000 7f3165ffb700 1 --2- 172.21.15.3:0/1699750625 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3154068340 0x7f315406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.087+0000 7f3165ffb700 1 -- 172.21.15.3:0/1699750625 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3168087250 con 0x7f31701539b0 2023-03-06T14:16:20.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.087+0000 7f317567e700 1 --2- 172.21.15.3:0/1699750625 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3154068340 0x7f315406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.088+0000 7f3165ffb700 1 --2- 172.21.15.3:0/1699750625 >> [v2:172.21.15.3:6808/96679,v1:172.21.15.3:6809/96679] conn(0x7f3154072010 0x7f3154074440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.088+0000 7f3165ffb700 1 -- 172.21.15.3:0/1699750625 --> [v2:172.21.15.3:6808/96679,v1:172.21.15.3:6809/96679] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3154074b10 con 0x7f3154072010 2023-03-06T14:16:20.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.088+0000 7f3165ffb700 1 -- 172.21.15.3:0/1699750625 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31680876d0 con 0x7f31701539b0 2023-03-06T14:16:20.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.088+0000 7f3174e7d700 1 --2- 172.21.15.3:0/1699750625 >> [v2:172.21.15.3:6808/96679,v1:172.21.15.3:6809/96679] conn(0x7f3154072010 0x7f3154074440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.088+0000 7f317567e700 1 --2- 172.21.15.3:0/1699750625 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3154068340 0x7f315406a7f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f31700bb1a0 tx=0x7f3160009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.088+0000 7f3174e7d700 1 --2- 172.21.15.3:0/1699750625 >> [v2:172.21.15.3:6808/96679,v1:172.21.15.3:6809/96679] conn(0x7f3154072010 0x7f3154074440 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.078+0000 7f970ad9d700 1 --2- 172.21.15.3:0/1644793862 >> [v2:172.21.15.3:6800/96680,v1:172.21.15.3:6801/96680] conn(0x7f96f00015d0 0x7f96f0003a80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.089+0000 7f96faffd700 1 -- 172.21.15.3:0/1644793862 <== osd.3 v2:172.21.15.3:6800/96680 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f96f0006bb0 con 0x7f96f00015d0 2023-03-06T14:16:20.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.090+0000 7f3165ffb700 1 -- 172.21.15.3:0/1699750625 <== osd.0 v2:172.21.15.3:6808/96679 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3154074b10 con 0x7f3154072010 2023-03-06T14:16:20.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.091+0000 7f2dca3ac700 1 --2- 172.21.15.3:0/2866139373 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f2da80682e0 0x7f2da806a790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0001760 tx=0x7f2dc0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.091+0000 7f6fa0900700 1 -- 172.21.15.3:0/3243744845 --> [v2:172.21.15.3:6824/96681,v1:172.21.15.3:6825/96681] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6f9c1ec510 con 0x7f6f9c0bc840 2023-03-06T14:16:20.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.092+0000 7f6f8affd700 1 -- 172.21.15.3:0/3243744845 <== osd.1 v2:172.21.15.3:6824/96681 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6f9c1ec510 con 0x7f6f9c0bc840 2023-03-06T14:16:20.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.092+0000 7f6fa0900700 1 -- 172.21.15.3:0/3243744845 >> [v2:172.21.15.3:6824/96681,v1:172.21.15.3:6825/96681] conn(0x7f6f9c0bc840 msgr2=0x7f6f9c1ec7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.092+0000 7f6fa0900700 1 --2- 172.21.15.3:0/3243744845 >> [v2:172.21.15.3:6824/96681,v1:172.21.15.3:6825/96681] conn(0x7f6f9c0bc840 0x7f6f9c1ec7f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.092+0000 7f6fa0900700 1 -- 172.21.15.3:0/3243744845 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f6f7c068340 msgr2=0x7f6f7c06a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.092+0000 7f6fa0900700 1 --2- 172.21.15.3:0/3243744845 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f6f7c068340 0x7f6f7c06a7f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c1dd5d0 tx=0x7f6f8c014000 comp rx=0 tx=0).stop 2023-03-06T14:16:20.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.092+0000 7f6fa0900700 1 -- 172.21.15.3:0/3243744845 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f9c0b69e0 msgr2=0x7f6f9c14cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.092+0000 7f6fa0900700 1 --2- 172.21.15.3:0/3243744845 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f9c0b69e0 0x7f6f9c14cae0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6f94007f20 tx=0x7f6f9400e3c0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.092+0000 7f6f9ad9d700 1 -- 172.21.15.3:0/3243744845 reap_dead start 2023-03-06T14:16:20.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.092+0000 7f6fa0900700 1 -- 172.21.15.3:0/3243744845 shutdown_connections 2023-03-06T14:16:20.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.092+0000 7f6fa0900700 1 -- 172.21.15.3:0/3243744845 >> 172.21.15.3:0/3243744845 conn(0x7f6f9c0c1b40 msgr2=0x7f6f9c070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.093+0000 7f6fa0900700 1 -- 172.21.15.3:0/3243744845 shutdown_connections 2023-03-06T14:16:20.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.093+0000 7f6fa0900700 1 -- 172.21.15.3:0/3243744845 wait complete. 2023-03-06T14:16:20.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.101+0000 7f9211a44700 1 Processor -- start 2023-03-06T14:16:20.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.101+0000 7f9211a44700 1 -- start start 2023-03-06T14:16:20.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.103+0000 7f9211a44700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f920c0b69e0 0x7f920c0b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.103+0000 7f9211a44700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920c0bd330 con 0x7f920c1488d0 2023-03-06T14:16:20.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.103+0000 7f9211a44700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920c0bbef0 con 0x7f920c1539b0 2023-03-06T14:16:20.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.103+0000 7f9211a44700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f920c0b7610 con 0x7f920c0b69e0 2023-03-06T14:16:20.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.103+0000 7f920a7fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f920c0b69e0 0x7f920c0b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.103+0000 7f920a7fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f920c0b69e0 0x7f920c0b6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56200/0 (socket says 172.21.15.3:56200) 2023-03-06T14:16:20.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.103+0000 7f920a7fc700 1 -- 172.21.15.3:0/1746083007 learned_addr learned my addr 172.21.15.3:0/1746083007 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.103+0000 7f920a7fc700 1 -- 172.21.15.3:0/1746083007 >> v1:172.21.15.136:6789/0 conn(0x7f920c1539b0 legacy=0x7f920c155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.103+0000 7f920a7fc700 1 -- 172.21.15.3:0/1746083007 >> v1:172.21.15.3:6789/0 conn(0x7f920c1488d0 legacy=0x7f920c0b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.103+0000 7f920a7fc700 1 -- 172.21.15.3:0/1746083007 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c0bd580 con 0x7f920c0b69e0 2023-03-06T14:16:20.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.104+0000 7f920a7fc700 1 --2- 172.21.15.3:0/1746083007 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f920c0b69e0 0x7f920c0b6e60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9204009bd0 tx=0x7f920400d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d75e45517ec838f server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.104+0000 7f9209ffb700 1 -- 172.21.15.3:0/1746083007 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920400dcd0 con 0x7f920c0b69e0 2023-03-06T14:16:20.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.104+0000 7f9209ffb700 1 -- 172.21.15.3:0/1746083007 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920400de30 con 0x7f920c0b69e0 2023-03-06T14:16:20.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.104+0000 7f9209ffb700 1 -- 172.21.15.3:0/1746083007 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204003c60 con 0x7f920c0b69e0 2023-03-06T14:16:20.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.104+0000 7fe59dffb700 1 -- 172.21.15.3:0/986770244 --> [v2:172.21.15.136:6820/96798,v1:172.21.15.136:6822/96798] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe5a81548f0 con 0x7fe588071fc0 2023-03-06T14:16:20.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.105+0000 7f9211a44700 1 -- 172.21.15.3:0/1746083007 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f920c0b69e0 msgr2=0x7f920c0b6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.105+0000 7f9211a44700 1 --2- 172.21.15.3:0/1746083007 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f920c0b69e0 0x7f920c0b6e60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9204009bd0 tx=0x7f920400d3c0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.105+0000 7fe59ffff700 1 -- 172.21.15.3:0/986770244 <== osd.4 v2:172.21.15.136:6820/96798 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe5a00070b0 con 0x7fe588071fc0 2023-03-06T14:16:20.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.105+0000 7f9211a44700 1 -- 172.21.15.3:0/1746083007 shutdown_connections 2023-03-06T14:16:20.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.105+0000 7f9211a44700 1 --2- 172.21.15.3:0/1746083007 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f920c0b69e0 0x7f920c0b6e60 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9204009bd0 tx=0x7f920400d3c0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.105+0000 7f9211a44700 1 -- 172.21.15.3:0/1746083007 >> 172.21.15.3:0/1746083007 conn(0x7f920c0c1b40 msgr2=0x7f920c06a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.153 INFO:teuthology.orchestra.run.smithi003.stdout:55834574858 2023-03-06T14:16:20.154 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-03-06T14:16:20.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.106+0000 7f9211a44700 1 -- 172.21.15.3:0/1746083007 shutdown_connections 2023-03-06T14:16:20.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.106+0000 7f9211a44700 1 -- 172.21.15.3:0/1746083007 wait complete. 2023-03-06T14:16:20.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.106+0000 7f7ac896e700 1 -- 172.21.15.3:0/3821887158 --> [v2:172.21.15.3:6813/96682,v1:172.21.15.3:6815/96682] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7ac404e6e0 con 0x7f7aa4072010 2023-03-06T14:16:20.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.106+0000 7fe59dffb700 1 -- 172.21.15.3:0/986770244 >> [v2:172.21.15.136:6820/96798,v1:172.21.15.136:6822/96798] conn(0x7fe588071fc0 msgr2=0x7fe5880743f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.106+0000 7fe59dffb700 1 --2- 172.21.15.3:0/986770244 >> [v2:172.21.15.136:6820/96798,v1:172.21.15.136:6822/96798] conn(0x7fe588071fc0 0x7fe5880743f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.106+0000 7fe59dffb700 1 -- 172.21.15.3:0/986770244 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fe5880682f0 msgr2=0x7fe58806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.106+0000 7fe59dffb700 1 --2- 172.21.15.3:0/986770244 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fe5880682f0 0x7fe58806a7a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe590014040 tx=0x7fe590009030 comp rx=0 tx=0).stop 2023-03-06T14:16:20.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.106+0000 7fe59dffb700 1 -- 172.21.15.3:0/986770244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5a8157500 msgr2=0x7fe5a813c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.106+0000 7fe59dffb700 1 --2- 172.21.15.3:0/986770244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5a8157500 0x7fe5a813c090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe5980108c0 tx=0x7fe598010bd0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.107+0000 7fe5a77fe700 1 -- 172.21.15.3:0/986770244 reap_dead start 2023-03-06T14:16:20.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.107+0000 7f7ab2ffd700 1 -- 172.21.15.3:0/3821887158 <== osd.2 v2:172.21.15.3:6813/96682 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7ac404e6e0 con 0x7f7aa4072010 2023-03-06T14:16:20.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.107+0000 7f9211a44700 1 Processor -- start 2023-03-06T14:16:20.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.108+0000 7f9211a44700 1 -- start start 2023-03-06T14:16:20.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.108+0000 7f7ac896e700 1 -- 172.21.15.3:0/3821887158 >> [v2:172.21.15.3:6813/96682,v1:172.21.15.3:6815/96682] conn(0x7f7aa4072010 msgr2=0x7f7aa4074440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.108+0000 7f7ac896e700 1 --2- 172.21.15.3:0/3821887158 >> [v2:172.21.15.3:6813/96682,v1:172.21.15.3:6815/96682] conn(0x7f7aa4072010 0x7f7aa4074440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.108+0000 7fe59dffb700 1 -- 172.21.15.3:0/986770244 shutdown_connections 2023-03-06T14:16:20.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.108+0000 7fe59dffb700 1 -- 172.21.15.3:0/986770244 >> 172.21.15.3:0/986770244 conn(0x7fe5a80c1b40 msgr2=0x7fe5a8152a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f7ac896e700 1 -- 172.21.15.3:0/3821887158 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f7aa40683c0 msgr2=0x7f7aa406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f7ac896e700 1 --2- 172.21.15.3:0/3821887158 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f7aa40683c0 0x7f7aa406a870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8019040 tx=0x7f7ab8012000 comp rx=0 tx=0).stop 2023-03-06T14:16:20.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f7ac896e700 1 -- 172.21.15.3:0/3821887158 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ac40b69e0 msgr2=0x7f7ac40b8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f7ac896e700 1 --2- 172.21.15.3:0/3821887158 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ac40b69e0 0x7f7ac40b8250 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400c440 tx=0x7f7ab400c750 comp rx=0 tx=0).stop 2023-03-06T14:16:20.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f7ac2d9d700 1 -- 172.21.15.3:0/3821887158 reap_dead start 2023-03-06T14:16:20.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f7ac896e700 1 -- 172.21.15.3:0/3821887158 shutdown_connections 2023-03-06T14:16:20.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f7ac896e700 1 -- 172.21.15.3:0/3821887158 >> 172.21.15.3:0/3821887158 conn(0x7f7ac40c1b40 msgr2=0x7f7ac40b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f9211a44700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f920c1488d0 0x7f920c13e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f9211a44700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f920c1539b0 0x7f920c14a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f9211a44700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f920c1467b0 0x7f920c142610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f9211a44700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920c13e7b0 con 0x7f920c1488d0 2023-03-06T14:16:20.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f9211a44700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920c14a0e0 con 0x7f920c1539b0 2023-03-06T14:16:20.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f9211a44700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920c14aab0 con 0x7f920c1467b0 2023-03-06T14:16:20.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f920affd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f920c1488d0 0x7f920c13e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f920affd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f920c1488d0 0x7f920c13e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56204/0 (socket says 172.21.15.3:56204) 2023-03-06T14:16:20.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f920affd700 1 -- 172.21.15.3:0/656015129 learned_addr learned my addr 172.21.15.3:0/656015129 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f7ac896e700 1 -- 172.21.15.3:0/3821887158 shutdown_connections 2023-03-06T14:16:20.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f920b7fe700 1 --2- 172.21.15.3:0/656015129 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f920c1467b0 0x7f920c142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f7ac896e700 1 -- 172.21.15.3:0/3821887158 wait complete. 2023-03-06T14:16:20.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.109+0000 7f920a7fc700 1 --2- 172.21.15.3:0/656015129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f920c1539b0 0x7f920c14a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.110+0000 7f920affd700 1 -- 172.21.15.3:0/656015129 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f920c1467b0 msgr2=0x7f920c142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.110+0000 7f920affd700 1 --2- 172.21.15.3:0/656015129 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f920c1467b0 0x7f920c142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.110+0000 7f920affd700 1 -- 172.21.15.3:0/656015129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f920c1539b0 msgr2=0x7f920c14a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.110+0000 7f920affd700 1 --2- 172.21.15.3:0/656015129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f920c1539b0 0x7f920c14a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.110+0000 7f920affd700 1 -- 172.21.15.3:0/656015129 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9204009830 con 0x7f920c1488d0 2023-03-06T14:16:20.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.110+0000 7f920affd700 1 --2- 172.21.15.3:0/656015129 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f920c1488d0 0x7f920c13e9f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f920000c500 tx=0x7f920000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.110+0000 7f2dcc610700 1 -- 172.21.15.3:0/2866139373 --> [v2:172.21.15.136:6816/96819,v1:172.21.15.136:6817/96819] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2dc41e4e90 con 0x7f2da8071fb0 2023-03-06T14:16:20.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.110+0000 7f91f3fff700 1 -- 172.21.15.3:0/656015129 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9200011790 con 0x7f920c1488d0 2023-03-06T14:16:20.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.110+0000 7f91f3fff700 1 -- 172.21.15.3:0/656015129 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92000118f0 con 0x7f920c1488d0 2023-03-06T14:16:20.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.110+0000 7f91f3fff700 1 -- 172.21.15.3:0/656015129 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9200011ca0 con 0x7f920c1488d0 2023-03-06T14:16:20.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.110+0000 7f2dbaffd700 1 -- 172.21.15.3:0/2866139373 <== osd.7 v2:172.21.15.136:6816/96819 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2dc41e4e90 con 0x7f2da8071fb0 2023-03-06T14:16:20.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.111+0000 7f2dcc610700 1 -- 172.21.15.3:0/2866139373 >> [v2:172.21.15.136:6816/96819,v1:172.21.15.136:6817/96819] conn(0x7f2da8071fb0 msgr2=0x7f2da80743e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.111+0000 7f2dcc610700 1 --2- 172.21.15.3:0/2866139373 >> [v2:172.21.15.136:6816/96819,v1:172.21.15.136:6817/96819] conn(0x7f2da8071fb0 0x7f2da80743e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.111+0000 7f2dcc610700 1 -- 172.21.15.3:0/2866139373 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f2da80682e0 msgr2=0x7f2da806a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.111+0000 7f2dcc610700 1 --2- 172.21.15.3:0/2866139373 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f2da80682e0 0x7f2da806a790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0001760 tx=0x7f2dc0009040 comp rx=0 tx=0).stop 2023-03-06T14:16:20.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.111+0000 7f2dcc610700 1 -- 172.21.15.3:0/2866139373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dc41e5040 msgr2=0x7f2dc41e54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.111+0000 7f2dcc610700 1 --2- 172.21.15.3:0/2866139373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dc41e5040 0x7f2dc41e54b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2db400f970 tx=0x7f2db400fc80 comp rx=0 tx=0).stop 2023-03-06T14:16:20.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.111+0000 7f2dcabad700 1 -- 172.21.15.3:0/2866139373 reap_dead start 2023-03-06T14:16:20.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.111+0000 7f9211a44700 1 -- 172.21.15.3:0/656015129 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f920c14bf00 con 0x7f920c1488d0 2023-03-06T14:16:20.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.111+0000 7f9211a44700 1 -- 172.21.15.3:0/656015129 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920c14bc20 con 0x7f920c1488d0 2023-03-06T14:16:20.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.112+0000 7f9211a44700 1 -- 172.21.15.3:0/656015129 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f920c06c390 con 0x7f920c1488d0 2023-03-06T14:16:20.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.112+0000 7fe59dffb700 1 -- 172.21.15.3:0/986770244 shutdown_connections 2023-03-06T14:16:20.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.113+0000 7fe59dffb700 1 -- 172.21.15.3:0/986770244 wait complete. 2023-03-06T14:16:20.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.112+0000 7f0fc2680700 1 -- 172.21.15.3:0/3684559497 --> [v2:172.21.15.136:6802/96796,v1:172.21.15.136:6804/96796] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0f98002d30 con 0x7f0fa0071f90 2023-03-06T14:16:20.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.113+0000 7f2dcc610700 1 -- 172.21.15.3:0/2866139373 shutdown_connections 2023-03-06T14:16:20.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.113+0000 7f2dcc610700 1 -- 172.21.15.3:0/2866139373 >> 172.21.15.3:0/2866139373 conn(0x7f2dc40c1b40 msgr2=0x7f2dc415de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.113+0000 7f2dcc610700 1 -- 172.21.15.3:0/2866139373 shutdown_connections 2023-03-06T14:16:20.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.113+0000 7f2dcc610700 1 -- 172.21.15.3:0/2866139373 wait complete. 2023-03-06T14:16:20.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.113+0000 7f0fb8ff9700 1 -- 172.21.15.3:0/3684559497 <== osd.5 v2:172.21.15.136:6802/96796 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0f98002d30 con 0x7f0fa0071f90 2023-03-06T14:16:20.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.114+0000 7f91f3fff700 1 -- 172.21.15.3:0/656015129 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9200010050 con 0x7f920c1488d0 2023-03-06T14:16:20.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.114+0000 7f91f3fff700 1 --2- 172.21.15.3:0/656015129 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f91f80682f0 0x7f91f806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.114+0000 7f91f3fff700 1 -- 172.21.15.3:0/656015129 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9200085500 con 0x7f920c1488d0 2023-03-06T14:16:20.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.115+0000 7f920a7fc700 1 --2- 172.21.15.3:0/656015129 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f91f80682f0 0x7f91f806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.115+0000 7f91f3fff700 1 --2- 172.21.15.3:0/656015129 >> [v2:172.21.15.136:6800/96797,v1:172.21.15.136:6801/96797] conn(0x7f91f8071f40 0x7f91f8074370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.115+0000 7f91f3fff700 1 -- 172.21.15.3:0/656015129 --> [v2:172.21.15.136:6800/96797,v1:172.21.15.136:6801/96797] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91f8074a40 con 0x7f91f8071f40 2023-03-06T14:16:20.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.115+0000 7f91f3fff700 1 -- 172.21.15.3:0/656015129 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9200085800 con 0x7f920c1488d0 2023-03-06T14:16:20.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.115+0000 7f920a7fc700 1 --2- 172.21.15.3:0/656015129 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f91f80682f0 0x7f91f806a7a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f920c0b6db0 tx=0x7f9204012000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.116+0000 7f920b7fe700 1 --2- 172.21.15.3:0/656015129 >> [v2:172.21.15.136:6800/96797,v1:172.21.15.136:6801/96797] conn(0x7f91f8071f40 0x7f91f8074370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.119+0000 7f920b7fe700 1 --2- 172.21.15.3:0/656015129 >> [v2:172.21.15.136:6800/96797,v1:172.21.15.136:6801/96797] conn(0x7f91f8071f40 0x7f91f8074370 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.119+0000 7f9710e66700 1 -- 172.21.15.3:0/1644793862 --> [v2:172.21.15.3:6800/96680,v1:172.21.15.3:6801/96680] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f96f0005c90 con 0x7f96f00015d0 2023-03-06T14:16:20.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.120+0000 7f96faffd700 1 -- 172.21.15.3:0/1644793862 <== osd.3 v2:172.21.15.3:6800/96680 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f96f0005c90 con 0x7f96f00015d0 2023-03-06T14:16:20.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.120+0000 7f9710e66700 1 -- 172.21.15.3:0/1644793862 >> [v2:172.21.15.3:6800/96680,v1:172.21.15.3:6801/96680] conn(0x7f96f00015d0 msgr2=0x7f96f0003a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.120+0000 7f9710e66700 1 --2- 172.21.15.3:0/1644793862 >> [v2:172.21.15.3:6800/96680,v1:172.21.15.3:6801/96680] conn(0x7f96f00015d0 0x7f96f0003a80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.120+0000 7f9710e66700 1 -- 172.21.15.3:0/1644793862 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f96ec068340 msgr2=0x7f96ec06a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.120+0000 7f9710e66700 1 --2- 172.21.15.3:0/1644793862 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f96ec068340 0x7f96ec06a7f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f970c06a960 tx=0x7f970000c040 comp rx=0 tx=0).stop 2023-03-06T14:16:20.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.120+0000 7f9710e66700 1 -- 172.21.15.3:0/1644793862 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f970c071b40 msgr2=0x7f970c088c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.120+0000 7f9710e66700 1 --2- 172.21.15.3:0/1644793862 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f970c071b40 0x7f970c088c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00c4a0 tx=0x7f96fc00c7b0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.120+0000 7f970ad9d700 1 -- 172.21.15.3:0/1644793862 reap_dead start 2023-03-06T14:16:20.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.120+0000 7f9710e66700 1 -- 172.21.15.3:0/1644793862 shutdown_connections 2023-03-06T14:16:20.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.120+0000 7f9710e66700 1 -- 172.21.15.3:0/1644793862 >> 172.21.15.3:0/1644793862 conn(0x7f970c0c1b40 msgr2=0x7f970c15dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.121+0000 7f9710e66700 1 -- 172.21.15.3:0/1644793862 shutdown_connections 2023-03-06T14:16:20.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.121+0000 7f9710e66700 1 -- 172.21.15.3:0/1644793862 wait complete. 2023-03-06T14:16:20.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.115+0000 7f0fc2680700 1 -- 172.21.15.3:0/3684559497 >> [v2:172.21.15.136:6802/96796,v1:172.21.15.136:6804/96796] conn(0x7f0fa0071f90 msgr2=0x7f0fa00743c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.115+0000 7f0fc2680700 1 --2- 172.21.15.3:0/3684559497 >> [v2:172.21.15.136:6802/96796,v1:172.21.15.136:6804/96796] conn(0x7f0fa0071f90 0x7f0fa00743c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.115+0000 7f0fc2680700 1 -- 172.21.15.3:0/3684559497 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0fa00682c0 msgr2=0x7f0fa006a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.115+0000 7f0fc2680700 1 --2- 172.21.15.3:0/3684559497 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0fa00682c0 0x7f0fa006a770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc1472b0 tx=0x7f0fac008040 comp rx=0 tx=0).stop 2023-03-06T14:16:20.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.115+0000 7f0fc2680700 1 -- 172.21.15.3:0/3684559497 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0fbc0b69e0 msgr2=0x7f0fbc141ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.115+0000 7f0fc2680700 1 --2- 172.21.15.3:0/3684559497 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0fbc0b69e0 0x7f0fbc141ce0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400bd50 tx=0x7f0fb400bd80 comp rx=0 tx=0).stop 2023-03-06T14:16:20.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.115+0000 7f0fc0c1d700 1 -- 172.21.15.3:0/3684559497 reap_dead start 2023-03-06T14:16:20.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.116+0000 7f0fc2680700 1 -- 172.21.15.3:0/3684559497 shutdown_connections 2023-03-06T14:16:20.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.116+0000 7f0fc2680700 1 -- 172.21.15.3:0/3684559497 >> 172.21.15.3:0/3684559497 conn(0x7f0fbc0c1b40 msgr2=0x7f0fbc0bc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.116+0000 7f0fc2680700 1 -- 172.21.15.3:0/3684559497 shutdown_connections 2023-03-06T14:16:20.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.116+0000 7f0fc2680700 1 -- 172.21.15.3:0/3684559497 wait complete. 2023-03-06T14:16:20.177 INFO:teuthology.orchestra.run.smithi003.stdout:55834574858 2023-03-06T14:16:20.177 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-03-06T14:16:20.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.129+0000 7f31778e2700 1 -- 172.21.15.3:0/1699750625 --> [v2:172.21.15.3:6808/96679,v1:172.21.15.3:6809/96679] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3150002d30 con 0x7f3154072010 2023-03-06T14:16:20.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.129+0000 7f91f3fff700 1 -- 172.21.15.3:0/656015129 <== osd.6 v2:172.21.15.136:6800/96797 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f91f8074a40 con 0x7f91f8071f40 2023-03-06T14:16:20.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.130+0000 7f3165ffb700 1 -- 172.21.15.3:0/1699750625 <== osd.0 v2:172.21.15.3:6808/96679 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3150002d30 con 0x7f3154072010 2023-03-06T14:16:20.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.130+0000 7f31778e2700 1 -- 172.21.15.3:0/1699750625 >> [v2:172.21.15.3:6808/96679,v1:172.21.15.3:6809/96679] conn(0x7f3154072010 msgr2=0x7f3154074440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.130+0000 7f31778e2700 1 --2- 172.21.15.3:0/1699750625 >> [v2:172.21.15.3:6808/96679,v1:172.21.15.3:6809/96679] conn(0x7f3154072010 0x7f3154074440 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.131+0000 7f31778e2700 1 -- 172.21.15.3:0/1699750625 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3154068340 msgr2=0x7f315406a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.131+0000 7f31778e2700 1 --2- 172.21.15.3:0/1699750625 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3154068340 0x7f315406a7f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f31700bb1a0 tx=0x7f3160009040 comp rx=0 tx=0).stop 2023-03-06T14:16:20.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.131+0000 7f31778e2700 1 -- 172.21.15.3:0/1699750625 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31701539b0 msgr2=0x7f3170140700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.131+0000 7f31778e2700 1 --2- 172.21.15.3:0/1699750625 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31701539b0 0x7f3170140700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f31700bc030 tx=0x7f3168004ad0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.131+0000 7f3175e7f700 1 -- 172.21.15.3:0/1699750625 reap_dead start 2023-03-06T14:16:20.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.131+0000 7f31778e2700 1 -- 172.21.15.3:0/1699750625 shutdown_connections 2023-03-06T14:16:20.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.131+0000 7f31778e2700 1 -- 172.21.15.3:0/1699750625 >> 172.21.15.3:0/1699750625 conn(0x7f31700c1b40 msgr2=0x7f31701431f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.131+0000 7f31778e2700 1 -- 172.21.15.3:0/1699750625 shutdown_connections 2023-03-06T14:16:20.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.131+0000 7f31778e2700 1 -- 172.21.15.3:0/1699750625 wait complete. 2023-03-06T14:16:20.181 INFO:teuthology.orchestra.run.smithi003.stdout:55834574858 2023-03-06T14:16:20.181 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-03-06T14:16:20.182 INFO:teuthology.orchestra.run.smithi003.stdout:55834574859 2023-03-06T14:16:20.182 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-03-06T14:16:20.183 INFO:teuthology.orchestra.run.smithi003.stdout:55834574860 2023-03-06T14:16:20.184 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-03-06T14:16:20.184 INFO:teuthology.orchestra.run.smithi003.stdout:55834574859 2023-03-06T14:16:20.185 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-03-06T14:16:20.185 INFO:teuthology.orchestra.run.smithi003.stdout:55834574860 2023-03-06T14:16:20.186 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-03-06T14:16:20.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.155+0000 7f9211a44700 1 -- 172.21.15.3:0/656015129 --> [v2:172.21.15.136:6800/96797,v1:172.21.15.136:6801/96797] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f920c14a220 con 0x7f91f8071f40 2023-03-06T14:16:20.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.156+0000 7f91f3fff700 1 -- 172.21.15.3:0/656015129 <== osd.6 v2:172.21.15.136:6800/96797 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f91fc00b8d0 con 0x7f91f8071f40 2023-03-06T14:16:20.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.157+0000 7f9211a44700 1 -- 172.21.15.3:0/656015129 >> [v2:172.21.15.136:6800/96797,v1:172.21.15.136:6801/96797] conn(0x7f91f8071f40 msgr2=0x7f91f8074370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.157+0000 7f9211a44700 1 --2- 172.21.15.3:0/656015129 >> [v2:172.21.15.136:6800/96797,v1:172.21.15.136:6801/96797] conn(0x7f91f8071f40 0x7f91f8074370 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.157+0000 7f9211a44700 1 -- 172.21.15.3:0/656015129 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f91f80682f0 msgr2=0x7f91f806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.157+0000 7f9211a44700 1 --2- 172.21.15.3:0/656015129 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f91f80682f0 0x7f91f806a7a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f920c0b6db0 tx=0x7f9204012000 comp rx=0 tx=0).stop 2023-03-06T14:16:20.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.157+0000 7f9211a44700 1 -- 172.21.15.3:0/656015129 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f920c1488d0 msgr2=0x7f920c13e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.157+0000 7f9211a44700 1 --2- 172.21.15.3:0/656015129 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f920c1488d0 0x7f920c13e9f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f920000c500 tx=0x7f920000c8c0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.157+0000 7f920b7fe700 1 -- 172.21.15.3:0/656015129 reap_dead start 2023-03-06T14:16:20.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.157+0000 7f9211a44700 1 -- 172.21.15.3:0/656015129 shutdown_connections 2023-03-06T14:16:20.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.157+0000 7f9211a44700 1 -- 172.21.15.3:0/656015129 >> 172.21.15.3:0/656015129 conn(0x7f920c0c1b40 msgr2=0x7f920c143e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.157+0000 7f9211a44700 1 -- 172.21.15.3:0/656015129 shutdown_connections 2023-03-06T14:16:20.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.157+0000 7f9211a44700 1 -- 172.21.15.3:0/656015129 wait complete. 2023-03-06T14:16:20.190 INFO:teuthology.orchestra.run.smithi003.stdout:55834574858 2023-03-06T14:16:20.190 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-03-06T14:16:20.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.407+0000 7fd991527700 1 Processor -- start 2023-03-06T14:16:20.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.407+0000 7fd991527700 1 -- start start 2023-03-06T14:16:20.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.408+0000 7fd991527700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd98c0bd320 0x7fd98c14e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.408+0000 7fd991527700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd98c14ec90 0x7fd98c06e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.408+0000 7fd991527700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd98c0bbea0 con 0x7fd98c06c810 2023-03-06T14:16:20.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.408+0000 7fd991527700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98c0b64a0 con 0x7fd98c0bd320 2023-03-06T14:16:20.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.408+0000 7fd991527700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c0bba50 con 0x7fd98c14ec90 2023-03-06T14:16:20.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.409+0000 7fd98b7fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd98c14ec90 0x7fd98c06e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.409+0000 7fd98a7fc700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd98c0bd320 0x7fd98c14e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.409+0000 7fd98a7fc700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd98c0bd320 0x7fd98c14e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.3:42308/0 (socket says 172.21.15.3:42308) 2023-03-06T14:16:20.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.409+0000 7fd98a7fc700 1 -- 172.21.15.3:0/769727834 learned_addr learned my addr 172.21.15.3:0/769727834 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.410+0000 7fd98a7fc700 1 -- 172.21.15.3:0/769727834 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd98c14ec90 msgr2=0x7fd98c06e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.410+0000 7fd98a7fc700 1 --2- 172.21.15.3:0/769727834 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd98c14ec90 0x7fd98c06e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.410+0000 7fd98a7fc700 1 -- 172.21.15.3:0/769727834 >> v1:172.21.15.3:6789/0 conn(0x7fd98c06c810 legacy=0x7fd98c06b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.410+0000 7fd98a7fc700 1 -- 172.21.15.3:0/769727834 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c0bcc80 con 0x7fd98c0bd320 2023-03-06T14:16:20.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.412+0000 7fd98a7fc700 1 --2- 172.21.15.3:0/769727834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd98c0bd320 0x7fd98c14e750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0b65e0 tx=0x7fd980009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85ce98fde6044692 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.412+0000 7fd989ffb700 1 -- 172.21.15.3:0/769727834 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd980004230 con 0x7fd98c0bd320 2023-03-06T14:16:20.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.412+0000 7fd989ffb700 1 -- 172.21.15.3:0/769727834 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd980004390 con 0x7fd98c0bd320 2023-03-06T14:16:20.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.412+0000 7fd989ffb700 1 -- 172.21.15.3:0/769727834 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9800036a0 con 0x7fd98c0bd320 2023-03-06T14:16:20.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.413+0000 7fd991527700 1 -- 172.21.15.3:0/769727834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd98c0bd320 msgr2=0x7fd98c14e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.413+0000 7fd991527700 1 --2- 172.21.15.3:0/769727834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd98c0bd320 0x7fd98c14e750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0b65e0 tx=0x7fd980009bd0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.413+0000 7fd991527700 1 -- 172.21.15.3:0/769727834 shutdown_connections 2023-03-06T14:16:20.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.413+0000 7fd991527700 1 --2- 172.21.15.3:0/769727834 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd98c14ec90 0x7fd98c06e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.413+0000 7fd991527700 1 --2- 172.21.15.3:0/769727834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd98c0bd320 0x7fd98c14e750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.413+0000 7fd991527700 1 -- 172.21.15.3:0/769727834 >> 172.21.15.3:0/769727834 conn(0x7fd98c0c0eb0 msgr2=0x7fd98c0c12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.414+0000 7fd991527700 1 -- 172.21.15.3:0/769727834 shutdown_connections 2023-03-06T14:16:20.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.414+0000 7fd991527700 1 -- 172.21.15.3:0/769727834 wait complete. 2023-03-06T14:16:20.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.416+0000 7fd991527700 1 Processor -- start 2023-03-06T14:16:20.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.416+0000 7fd991527700 1 -- start start 2023-03-06T14:16:20.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.417+0000 7fd991527700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd98c06c810 0x7fd98c1411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.417+0000 7fd991527700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd98c0bd320 0x7fd98c1ebd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.417+0000 7fd991527700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd98c14ec90 0x7fd98c1ec2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.417+0000 7fd991527700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c0b9230 con 0x7fd98c0bd320 2023-03-06T14:16:20.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.417+0000 7fd991527700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c0b8560 con 0x7fd98c06c810 2023-03-06T14:16:20.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.417+0000 7fd991527700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c0b8280 con 0x7fd98c14ec90 2023-03-06T14:16:20.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.418+0000 7fd98b7fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd98c14ec90 0x7fd98c1ec2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.418+0000 7fd98b7fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd98c14ec90 0x7fd98c1ec2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.3:49202/0 (socket says 172.21.15.3:49202) 2023-03-06T14:16:20.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.418+0000 7fd98b7fe700 1 -- 172.21.15.3:0/3223038832 learned_addr learned my addr 172.21.15.3:0/3223038832 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.419+0000 7fd98b7fe700 1 -- 172.21.15.3:0/3223038832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd98c06c810 msgr2=0x7fd98c1411a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-06T14:16:20.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.419+0000 7fd98b7fe700 1 --2- 172.21.15.3:0/3223038832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd98c06c810 0x7fd98c1411a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.419+0000 7fd98b7fe700 1 -- 172.21.15.3:0/3223038832 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd98c0bd320 msgr2=0x7fd98c1ebd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.419+0000 7fd98b7fe700 1 --2- 172.21.15.3:0/3223038832 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd98c0bd320 0x7fd98c1ebd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.419+0000 7fd98b7fe700 1 -- 172.21.15.3:0/3223038832 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd980009550 con 0x7fd98c14ec90 2023-03-06T14:16:20.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.419+0000 7fd98b7fe700 1 --2- 172.21.15.3:0/3223038832 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd98c14ec90 0x7fd98c1ec2b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd984009d30 tx=0x7fd98400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.420+0000 7fd9737fe700 1 -- 172.21.15.3:0/3223038832 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd984009ba0 con 0x7fd98c14ec90 2023-03-06T14:16:20.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.420+0000 7fd9737fe700 1 -- 172.21.15.3:0/3223038832 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98400f040 con 0x7fd98c14ec90 2023-03-06T14:16:20.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.420+0000 7fd9737fe700 1 -- 172.21.15.3:0/3223038832 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd984014480 con 0x7fd98c14ec90 2023-03-06T14:16:20.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.420+0000 7fd991527700 1 -- 172.21.15.3:0/3223038832 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98c0b66b0 con 0x7fd98c14ec90 2023-03-06T14:16:20.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.420+0000 7fd991527700 1 -- 172.21.15.3:0/3223038832 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98c0bcf20 con 0x7fd98c14ec90 2023-03-06T14:16:20.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.423+0000 7fd991527700 1 -- 172.21.15.3:0/3223038832 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98c0b6990 con 0x7fd98c14ec90 2023-03-06T14:16:20.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.424+0000 7fd9737fe700 1 -- 172.21.15.3:0/3223038832 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd9840145e0 con 0x7fd98c14ec90 2023-03-06T14:16:20.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.424+0000 7fd9737fe700 1 --2- 172.21.15.3:0/3223038832 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fd974068520 0x7fd97406a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.425+0000 7fd9737fe700 1 -- 172.21.15.3:0/3223038832 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd984086bd0 con 0x7fd98c14ec90 2023-03-06T14:16:20.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.425+0000 7fd98affd700 1 --2- 172.21.15.3:0/3223038832 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fd974068520 0x7fd97406a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.427+0000 7fd98affd700 1 --2- 172.21.15.3:0/3223038832 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fd974068520 0x7fd97406a9d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd97c000f60 tx=0x7fd97c007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.430+0000 7fd9737fe700 1 -- 172.21.15.3:0/3223038832 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd9840530d0 con 0x7fd98c14ec90 2023-03-06T14:16:20.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.445+0000 7fd5e539a700 1 Processor -- start 2023-03-06T14:16:20.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.445+0000 7fd5e539a700 1 -- start start 2023-03-06T14:16:20.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.446+0000 7fd5e539a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd5e01488d0 0x7fd5e00b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.446+0000 7fd5e539a700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5e00b69e0 0x7fd5e00b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.446+0000 7fd5e539a700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd5e00704b0 0x7fd5e014ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.446+0000 7fd5e539a700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e00b7610 con 0x7fd5e00704b0 2023-03-06T14:16:20.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.446+0000 7fd5e539a700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e00bd330 con 0x7fd5e01488d0 2023-03-06T14:16:20.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.446+0000 7fd5e539a700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00bbef0 con 0x7fd5e00b69e0 2023-03-06T14:16:20.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.446+0000 7fd5deffd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd5e01488d0 0x7fd5e00b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.446+0000 7fd5deffd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd5e01488d0 0x7fd5e00b5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.3:42318/0 (socket says 172.21.15.3:42318) 2023-03-06T14:16:20.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.446+0000 7fd5deffd700 1 -- 172.21.15.3:0/4000871939 learned_addr learned my addr 172.21.15.3:0/4000871939 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.447+0000 7fd5df7fe700 1 --2- 172.21.15.3:0/4000871939 >> v2:172.21.15.3:3300/0 conn(0x7fd5e00704b0 0x7fd5e014ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.447+0000 7fd5deffd700 1 -- 172.21.15.3:0/4000871939 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5e00b69e0 msgr2=0x7fd5e00b6e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-06T14:16:20.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.447+0000 7fd5deffd700 1 --2- 172.21.15.3:0/4000871939 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5e00b69e0 0x7fd5e00b6e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.447+0000 7fd5deffd700 1 -- 172.21.15.3:0/4000871939 >> v2:172.21.15.3:3300/0 conn(0x7fd5e00704b0 msgr2=0x7fd5e014ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.447+0000 7fd5deffd700 1 --2- 172.21.15.3:0/4000871939 >> v2:172.21.15.3:3300/0 conn(0x7fd5e00704b0 0x7fd5e014ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.447+0000 7fd5deffd700 1 -- 172.21.15.3:0/4000871939 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e00bd580 con 0x7fd5e01488d0 2023-03-06T14:16:20.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.447+0000 7fd5df7fe700 1 --2- 172.21.15.3:0/4000871939 >> v2:172.21.15.3:3300/0 conn(0x7fd5e00704b0 0x7fd5e014ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:20.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.447+0000 7fd5deffd700 1 --2- 172.21.15.3:0/4000871939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5e01488d0 0x7fd5e00b5eb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0072b40 tx=0x7fd5d4009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e489ec8da3ee85f6 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.448+0000 7fd5ddffb700 1 -- 172.21.15.3:0/4000871939 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d400b870 con 0x7fd5e01488d0 2023-03-06T14:16:20.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.448+0000 7fd5ddffb700 1 -- 172.21.15.3:0/4000871939 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d400b9d0 con 0x7fd5e01488d0 2023-03-06T14:16:20.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.448+0000 7fd5ddffb700 1 -- 172.21.15.3:0/4000871939 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d400bd60 con 0x7fd5e01488d0 2023-03-06T14:16:20.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.449+0000 7fd5e539a700 1 -- 172.21.15.3:0/4000871939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5e01488d0 msgr2=0x7fd5e00b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.449+0000 7fd5e539a700 1 --2- 172.21.15.3:0/4000871939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5e01488d0 0x7fd5e00b5eb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0072b40 tx=0x7fd5d4009bd0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.449+0000 7fd5e539a700 1 -- 172.21.15.3:0/4000871939 shutdown_connections 2023-03-06T14:16:20.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.449+0000 7fd5e539a700 1 --2- 172.21.15.3:0/4000871939 >> v2:172.21.15.3:3300/0 conn(0x7fd5e00704b0 0x7fd5e014ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.449+0000 7fd5e539a700 1 --2- 172.21.15.3:0/4000871939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5e01488d0 0x7fd5e00b5eb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.449+0000 7fd5e539a700 1 --2- 172.21.15.3:0/4000871939 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5e00b69e0 0x7fd5e00b6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.449+0000 7fd5e539a700 1 -- 172.21.15.3:0/4000871939 >> 172.21.15.3:0/4000871939 conn(0x7fd5e00c1b40 msgr2=0x7fd5e006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.449+0000 7fd5e539a700 1 -- 172.21.15.3:0/4000871939 shutdown_connections 2023-03-06T14:16:20.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.449+0000 7fd5e539a700 1 -- 172.21.15.3:0/4000871939 wait complete. 2023-03-06T14:16:20.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.450+0000 7fd56f396700 1 Processor -- start 2023-03-06T14:16:20.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.450+0000 7f0a68c33700 1 Processor -- start 2023-03-06T14:16:20.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.451+0000 7f0a68c33700 1 -- start start 2023-03-06T14:16:20.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.451+0000 7fd5e539a700 1 Processor -- start 2023-03-06T14:16:20.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.451+0000 7fd5e539a700 1 -- start start 2023-03-06T14:16:20.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7fd5e539a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5e00704b0 0x7fd5e01ed120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7fd5e539a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5e00b69e0 0x7fd5e014a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7fd5e539a700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5e01488d0 0x7fd5e0139c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7fd5e539a700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e01ed700 con 0x7fd5e00b69e0 2023-03-06T14:16:20.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7fd5e539a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e0148e90 con 0x7fd5e00704b0 2023-03-06T14:16:20.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7fd5e539a700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e014a960 con 0x7fd5e01488d0 2023-03-06T14:16:20.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7f0a68c33700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0a640c1fe0 0x7f0a640c0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7f0a68c33700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0a6406fde0 0x7f0a640beb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7f0a68c33700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a64070670 con 0x7f0a640bf040 2023-03-06T14:16:20.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7f0a68c33700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a640c23b0 con 0x7f0a6406fde0 2023-03-06T14:16:20.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7f0a68c33700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a64151070 con 0x7f0a640c1fe0 2023-03-06T14:16:20.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7fd5de7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5e00b69e0 0x7fd5e014a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7fd5de7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5e00b69e0 0x7fd5e014a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56242/0 (socket says 172.21.15.3:56242) 2023-03-06T14:16:20.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7fd5de7fc700 1 -- 172.21.15.3:0/4237219533 learned_addr learned my addr 172.21.15.3:0/4237219533 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.451+0000 7fd56f396700 1 -- start start 2023-03-06T14:16:20.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7fd56f396700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5681488d0 0x7fd5680b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7fd56f396700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd5680b6e30 0x7fd56814ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7fd56f396700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5680bd330 con 0x7fd5680b69e0 2023-03-06T14:16:20.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7fd56f396700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5680b7610 con 0x7fd5680b6e30 2023-03-06T14:16:20.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7fd56f396700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680b7290 con 0x7fd5681488d0 2023-03-06T14:16:20.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7fd56c931700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd5680b69e0 0x7fd56814e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58518/0 (socket says 172.21.15.3:58518) 2023-03-06T14:16:20.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7fd56c931700 1 -- 172.21.15.3:0/78464162 learned_addr learned my addr 172.21.15.3:0/78464162 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:20.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.452+0000 7fd56d132700 1 --2- 172.21.15.3:0/78464162 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5681488d0 0x7fd5680b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.453+0000 7f0a62d9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f0a640bf040 0x7f0a64146950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58520/0 (socket says 172.21.15.3:58520) 2023-03-06T14:16:20.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.453+0000 7f0a62d9d700 1 -- 172.21.15.3:0/3235239765 learned_addr learned my addr 172.21.15.3:0/3235239765 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:20.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.453+0000 7fd56d933700 1 --2- 172.21.15.3:0/78464162 >> v2:172.21.15.136:3300/0 conn(0x7fd5680b6e30 0x7fd56814ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.453+0000 7fd5de7fc700 1 -- 172.21.15.3:0/4237219533 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5e01488d0 msgr2=0x7fd5e0139c00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-06T14:16:20.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.453+0000 7fd5de7fc700 1 --2- 172.21.15.3:0/4237219533 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5e01488d0 0x7fd5e0139c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.453+0000 7fd5de7fc700 1 -- 172.21.15.3:0/4237219533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5e00704b0 msgr2=0x7fd5e01ed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.453+0000 7fd5de7fc700 1 --2- 172.21.15.3:0/4237219533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5e00704b0 0x7fd5e01ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.453+0000 7fd5de7fc700 1 -- 172.21.15.3:0/4237219533 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d4009550 con 0x7fd5e00b69e0 2023-03-06T14:16:20.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.453+0000 7f0a61d9b700 1 --2- 172.21.15.3:0/3235239765 >> v2:172.21.15.3:3300/0 conn(0x7f0a6406fde0 0x7f0a640beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.453+0000 7fd5de7fc700 1 --2- 172.21.15.3:0/4237219533 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5e00b69e0 0x7fd5e014a420 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000b580 tx=0x7fd5d000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.453+0000 7fd56d132700 1 -- 172.21.15.3:0/78464162 >> v2:172.21.15.136:3300/0 conn(0x7fd5680b6e30 msgr2=0x7fd56814ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.453+0000 7fd56d132700 1 --2- 172.21.15.3:0/78464162 >> v2:172.21.15.136:3300/0 conn(0x7fd5680b6e30 0x7fd56814ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.453+0000 7fd56d132700 1 -- 172.21.15.3:0/78464162 >> v1:172.21.15.3:6789/0 conn(0x7fd5680b69e0 legacy=0x7fd56814e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.453+0000 7fd56d132700 1 -- 172.21.15.3:0/78464162 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5680bbef0 con 0x7fd5681488d0 2023-03-06T14:16:20.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.453+0000 7f0a6259c700 1 --2- 172.21.15.3:0/3235239765 >> v2:172.21.15.136:3300/0 conn(0x7f0a640c1fe0 0x7f0a640c0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.447+0000 7fa6fedc3700 1 Processor -- start 2023-03-06T14:16:20.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.447+0000 7fa6fedc3700 1 -- start start 2023-03-06T14:16:20.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.448+0000 7fa6fedc3700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa6f80b7a40 0x7fa6f80b6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.448+0000 7fa6fedc3700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f806ed80 con 0x7fa6f815fc50 2023-03-06T14:16:20.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.448+0000 7fa6fedc3700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f80712d0 con 0x7fa6f80b6530 2023-03-06T14:16:20.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.448+0000 7fa6fedc3700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f80b7870 con 0x7fa6f80b7a40 2023-03-06T14:16:20.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.448+0000 7fa6f7fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa6f80b7a40 0x7fa6f80b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.448+0000 7fa6fcb5f700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fa6f80b6530 0x7fa6f8071760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.3:55992/0 (socket says 172.21.15.3:55992) 2023-03-06T14:16:20.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.448+0000 7fa6fcb5f700 1 -- 172.21.15.3:0/3297559618 learned_addr learned my addr 172.21.15.3:0/3297559618 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:20.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.448+0000 7fa6f7fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa6f80b7a40 0x7fa6f80b6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56236/0 (socket says 172.21.15.3:56236) 2023-03-06T14:16:20.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.454+0000 7fd56d132700 1 --2- 172.21.15.3:0/78464162 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5681488d0 0x7fd5680b5eb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd560009d90 tx=0x7fd56000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f06f7dd70da32de9 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.453+0000 7f0a61d9b700 1 -- 172.21.15.3:0/3235239765 >> v2:172.21.15.136:3300/0 conn(0x7f0a640c1fe0 msgr2=0x7f0a640c0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.453+0000 7f0a61d9b700 1 --2- 172.21.15.3:0/3235239765 >> v2:172.21.15.136:3300/0 conn(0x7f0a640c1fe0 0x7f0a640c0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.453+0000 7f0a61d9b700 1 -- 172.21.15.3:0/3235239765 >> v1:172.21.15.3:6789/0 conn(0x7f0a640bf040 legacy=0x7f0a64146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.453+0000 7f0a61d9b700 1 -- 172.21.15.3:0/3235239765 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a64151350 con 0x7f0a6406fde0 2023-03-06T14:16:20.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.454+0000 7fd55ffff700 1 -- 172.21.15.3:0/78464162 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56000e070 con 0x7fd5681488d0 2023-03-06T14:16:20.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.454+0000 7fd55ffff700 1 -- 172.21.15.3:0/78464162 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56000bad0 con 0x7fd5681488d0 2023-03-06T14:16:20.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.454+0000 7fd55ffff700 1 -- 172.21.15.3:0/78464162 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56000be80 con 0x7fd5681488d0 2023-03-06T14:16:20.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.454+0000 7fd5c77fe700 1 -- 172.21.15.3:0/4237219533 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0011830 con 0x7fd5e00b69e0 2023-03-06T14:16:20.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.454+0000 7fd5c77fe700 1 -- 172.21.15.3:0/4237219533 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d00119b0 con 0x7fd5e00b69e0 2023-03-06T14:16:20.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.454+0000 7fd5c77fe700 1 -- 172.21.15.3:0/4237219533 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0011d60 con 0x7fd5e00b69e0 2023-03-06T14:16:20.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.449+0000 7fa6f77fe700 1 -- 172.21.15.3:0/3297559618 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335046432 0 0) 0x7fa6f80712d0 con 0x7fa6f80b6530 2023-03-06T14:16:20.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.454+0000 7fa6f77fe700 1 -- 172.21.15.3:0/3297559618 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6e80035b0 con 0x7fa6f80b6530 2023-03-06T14:16:20.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.454+0000 7fa6f77fe700 1 -- 172.21.15.3:0/3297559618 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649048849 0 0) 0x7fa6f806ed80 con 0x7fa6f815fc50 2023-03-06T14:16:20.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.454+0000 7fa6f77fe700 1 -- 172.21.15.3:0/3297559618 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6f80712d0 con 0x7fa6f815fc50 2023-03-06T14:16:20.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.454+0000 7fa6f7fff700 1 -- 172.21.15.3:0/3297559618 >> v1:172.21.15.136:6789/0 conn(0x7fa6f80b6530 legacy=0x7fa6f8071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.454+0000 7fa6f7fff700 1 -- 172.21.15.3:0/3297559618 >> v1:172.21.15.3:6789/0 conn(0x7fa6f815fc50 legacy=0x7fa6f8160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.454+0000 7fa6f7fff700 1 -- 172.21.15.3:0/3297559618 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f80bc040 con 0x7fa6f80b7a40 2023-03-06T14:16:20.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.454+0000 7fa6f7fff700 1 --2- 172.21.15.3:0/3297559618 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa6f80b7a40 0x7fa6f80b6900 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00b3f0 tx=0x7fa6ec00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d0b338680b73cc server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.455+0000 7fd56f396700 1 -- 172.21.15.3:0/78464162 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5681488d0 msgr2=0x7fd5680b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.455+0000 7fd56f396700 1 --2- 172.21.15.3:0/78464162 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5681488d0 0x7fd5680b5eb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd560009d90 tx=0x7fd56000b330 comp rx=0 tx=0).stop 2023-03-06T14:16:20.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.455+0000 7f0a61d9b700 1 --2- 172.21.15.3:0/3235239765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a6406fde0 0x7f0a640beb00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0a640c2530 tx=0x7f0a58009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3867a4e15790011 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.455+0000 7f474ad46700 1 Processor -- start 2023-03-06T14:16:20.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.455+0000 7f3cb0ce5700 1 Processor -- start 2023-03-06T14:16:20.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.455+0000 7fd5e539a700 1 -- 172.21.15.3:0/4237219533 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e014bf00 con 0x7fd5e00b69e0 2023-03-06T14:16:20.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.455+0000 7fd5e539a700 1 -- 172.21.15.3:0/4237219533 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e014bc20 con 0x7fd5e00b69e0 2023-03-06T14:16:20.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.456+0000 7fa6f77fe700 1 -- 172.21.15.3:0/3297559618 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec00e070 con 0x7fa6f80b7a40 2023-03-06T14:16:20.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.456+0000 7fa6f77fe700 1 -- 172.21.15.3:0/3297559618 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec00be40 con 0x7fa6f80b7a40 2023-03-06T14:16:20.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.456+0000 7fa6f77fe700 1 -- 172.21.15.3:0/3297559618 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec004230 con 0x7fa6f80b7a40 2023-03-06T14:16:20.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.456+0000 7fd56f396700 1 -- 172.21.15.3:0/78464162 shutdown_connections 2023-03-06T14:16:20.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.456+0000 7fd56f396700 1 --2- 172.21.15.3:0/78464162 >> v2:172.21.15.136:3300/0 conn(0x7fd5680b6e30 0x7fd56814ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.456+0000 7fd56f396700 1 --2- 172.21.15.3:0/78464162 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5681488d0 0x7fd5680b5eb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.456+0000 7fd56f396700 1 -- 172.21.15.3:0/78464162 >> 172.21.15.3:0/78464162 conn(0x7fd5680c1b40 msgr2=0x7fd56806a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.456+0000 7f0a6159a700 1 -- 172.21.15.3:0/3235239765 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a58011830 con 0x7f0a6406fde0 2023-03-06T14:16:20.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.456+0000 7f0a6159a700 1 -- 172.21.15.3:0/3235239765 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a58011990 con 0x7f0a6406fde0 2023-03-06T14:16:20.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.456+0000 7f0a6159a700 1 -- 172.21.15.3:0/3235239765 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a58011d20 con 0x7f0a6406fde0 2023-03-06T14:16:20.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7fd56f396700 1 -- 172.21.15.3:0/78464162 shutdown_connections 2023-03-06T14:16:20.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.455+0000 7f3cb0ce5700 1 -- start start 2023-03-06T14:16:20.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f3cb0ce5700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3cac156ca0 0x7f3cac0be360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f3cb0ce5700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3cac072820 0x7f3cac155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f3cb0ce5700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cac0bf7c0 con 0x7f3cac157070 2023-03-06T14:16:20.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f3cb0ce5700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cac14a3f0 con 0x7f3cac072820 2023-03-06T14:16:20.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f3cb0ce5700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cac0bca90 con 0x7f3cac156ca0 2023-03-06T14:16:20.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.455+0000 7f474ad46700 1 -- start start 2023-03-06T14:16:20.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.456+0000 7f474ad46700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4744156ca0 0x7f47440be360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f474ad46700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4744157070 0x7f4744072110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f474ad46700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f47440be8a0 0x7f4744072650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f474ad46700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f474414a3f0 con 0x7f47440be8a0 2023-03-06T14:16:20.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f474ad46700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47440bf7c0 con 0x7f4744156ca0 2023-03-06T14:16:20.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f474ad46700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47440bca90 con 0x7f4744157070 2023-03-06T14:16:20.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f3ca9d9b700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f3cac157070 0x7f3cac072110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58532/0 (socket says 172.21.15.3:58532) 2023-03-06T14:16:20.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f3ca9d9b700 1 -- 172.21.15.3:0/4291454140 learned_addr learned my addr 172.21.15.3:0/4291454140 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:20.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f4743fff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4744157070 0x7f4744072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f4743fff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4744157070 0x7f4744072110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.3:49238/0 (socket says 172.21.15.3:49238) 2023-03-06T14:16:20.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f4743fff700 1 -- 172.21.15.3:0/970383588 learned_addr learned my addr 172.21.15.3:0/970383588 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f47492e3700 1 --2- 172.21.15.3:0/970383588 >> v2:172.21.15.3:3300/0 conn(0x7f47440be8a0 0x7f4744072650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f4743fff700 1 -- 172.21.15.3:0/970383588 >> v2:172.21.15.136:3300/0 conn(0x7f4744156ca0 msgr2=0x7f47440be360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f0a68c33700 1 -- 172.21.15.3:0/3235239765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a6406fde0 msgr2=0x7f0a640beb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f0a68c33700 1 --2- 172.21.15.3:0/3235239765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a6406fde0 0x7f0a640beb00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0a640c2530 tx=0x7f0a58009b20 comp rx=0 tx=0).stop 2023-03-06T14:16:20.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7f4748ae2700 1 --2- 172.21.15.3:0/970383588 >> v2:172.21.15.136:3300/0 conn(0x7f4744156ca0 0x7f47440be360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.458+0000 7f3caa59c700 1 --2- 172.21.15.3:0/4291454140 >> v2:172.21.15.136:3300/0 conn(0x7f3cac156ca0 0x7f3cac0be360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.458+0000 7fd5c77fe700 1 -- 172.21.15.3:0/4237219533 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd5d0021070 con 0x7fd5e00b69e0 2023-03-06T14:16:20.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.458+0000 7f4743fff700 1 --2- 172.21.15.3:0/970383588 >> v2:172.21.15.136:3300/0 conn(0x7f4744156ca0 0x7f47440be360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.458+0000 7f4743fff700 1 -- 172.21.15.3:0/970383588 >> v2:172.21.15.3:3300/0 conn(0x7f47440be8a0 msgr2=0x7f4744072650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.458+0000 7f4743fff700 1 --2- 172.21.15.3:0/970383588 >> v2:172.21.15.3:3300/0 conn(0x7f47440be8a0 0x7f4744072650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.458+0000 7f4743fff700 1 -- 172.21.15.3:0/970383588 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47441549c0 con 0x7f4744157070 2023-03-06T14:16:20.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.458+0000 7f3caad9d700 1 --2- 172.21.15.3:0/4291454140 >> v2:172.21.15.3:3300/0 conn(0x7f3cac072820 0x7f3cac155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.458+0000 7f3caad9d700 1 -- 172.21.15.3:0/4291454140 >> v2:172.21.15.136:3300/0 conn(0x7f3cac156ca0 msgr2=0x7f3cac0be360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.458+0000 7f3caad9d700 1 --2- 172.21.15.3:0/4291454140 >> v2:172.21.15.136:3300/0 conn(0x7f3cac156ca0 0x7f3cac0be360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.458+0000 7f3caad9d700 1 -- 172.21.15.3:0/4291454140 >> v1:172.21.15.3:6789/0 conn(0x7f3cac157070 legacy=0x7f3cac072110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.458+0000 7fd5c77fe700 1 --2- 172.21.15.3:0/4237219533 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fd5cc0683c0 0x7fd5cc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.458+0000 7f3caad9d700 1 -- 172.21.15.3:0/4291454140 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac1549c0 con 0x7f3cac072820 2023-03-06T14:16:20.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.458+0000 7fd5c77fe700 1 -- 172.21.15.3:0/4237219533 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd5d0085f90 con 0x7fd5e00b69e0 2023-03-06T14:16:20.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.458+0000 7fd5e539a700 1 -- 172.21.15.3:0/4237219533 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e014f440 con 0x7fd5e00b69e0 2023-03-06T14:16:20.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.457+0000 7fd56f396700 1 -- 172.21.15.3:0/78464162 wait complete. 2023-03-06T14:16:20.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.458+0000 7fd56f396700 1 Processor -- start 2023-03-06T14:16:20.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.458+0000 7fd5deffd700 1 --2- 172.21.15.3:0/4237219533 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fd5cc0683c0 0x7fd5cc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.458+0000 7f0a68c33700 1 -- 172.21.15.3:0/3235239765 shutdown_connections 2023-03-06T14:16:20.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.459+0000 7f0a68c33700 1 --2- 172.21.15.3:0/3235239765 >> v2:172.21.15.136:3300/0 conn(0x7f0a640c1fe0 0x7f0a640c0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.459+0000 7f0a68c33700 1 --2- 172.21.15.3:0/3235239765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a6406fde0 0x7f0a640beb00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.459+0000 7f0a68c33700 1 -- 172.21.15.3:0/3235239765 >> 172.21.15.3:0/3235239765 conn(0x7f0a640c31d0 msgr2=0x7f0a640c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.459+0000 7f0a68c33700 1 -- 172.21.15.3:0/3235239765 shutdown_connections 2023-03-06T14:16:20.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.459+0000 7f0a68c33700 1 -- 172.21.15.3:0/3235239765 wait complete. 2023-03-06T14:16:20.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.459+0000 7f4743fff700 1 --2- 172.21.15.3:0/970383588 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4744157070 0x7f4744072110 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f474408ad50 tx=0x7f473c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1000c34704261997 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.459+0000 7f47437fe700 1 -- 172.21.15.3:0/970383588 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c00e070 con 0x7f4744157070 2023-03-06T14:16:20.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.459+0000 7f47437fe700 1 -- 172.21.15.3:0/970383588 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473c00b9c0 con 0x7f4744157070 2023-03-06T14:16:20.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.459+0000 7f47437fe700 1 -- 172.21.15.3:0/970383588 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c00bd50 con 0x7f4744157070 2023-03-06T14:16:20.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.459+0000 7fa6fedc3700 1 -- 172.21.15.3:0/3297559618 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa6f80b7a40 msgr2=0x7fa6f80b6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.459+0000 7fa6fedc3700 1 --2- 172.21.15.3:0/3297559618 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa6f80b7a40 0x7fa6f80b6900 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00b3f0 tx=0x7fa6ec00b700 comp rx=0 tx=0).stop 2023-03-06T14:16:20.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.459+0000 7fd56f396700 1 -- start start 2023-03-06T14:16:20.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.460+0000 7fd56f396700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5680b69e0 0x7fd568147780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.460+0000 7fd56f396700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5680b6e30 0x7fd5681ec6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.460+0000 7fd56f396700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5681488d0 0x7fd56813a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.460+0000 7fd56f396700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56806cac0 con 0x7fd5681488d0 2023-03-06T14:16:20.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.460+0000 7fd56f396700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd568147cc0 con 0x7fd5680b69e0 2023-03-06T14:16:20.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.460+0000 7fd56f396700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd568157870 con 0x7fd5680b6e30 2023-03-06T14:16:20.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.460+0000 7fa6fedc3700 1 -- 172.21.15.3:0/3297559618 shutdown_connections 2023-03-06T14:16:20.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.460+0000 7fa6fedc3700 1 --2- 172.21.15.3:0/3297559618 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa6f80b7a40 0x7fa6f80b6900 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.460+0000 7fa6fedc3700 1 -- 172.21.15.3:0/3297559618 >> 172.21.15.3:0/3297559618 conn(0x7fa6f80c1b40 msgr2=0x7fa6f806a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.459+0000 7f3caad9d700 1 --2- 172.21.15.3:0/4291454140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cac072820 0x7f3cac155bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3cac08ad50 tx=0x7f3ca4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5cd5baf4353a45 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.460+0000 7fa6fedc3700 1 -- 172.21.15.3:0/3297559618 shutdown_connections 2023-03-06T14:16:20.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.460+0000 7fd56d933700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5681488d0 0x7fd56813a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.460+0000 7fd56d933700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5681488d0 0x7fd56813a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56276/0 (socket says 172.21.15.3:56276) 2023-03-06T14:16:20.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.460+0000 7fd56d933700 1 -- 172.21.15.3:0/1354518168 learned_addr learned my addr 172.21.15.3:0/1354518168 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.460+0000 7fa6fedc3700 1 -- 172.21.15.3:0/3297559618 wait complete. 2023-03-06T14:16:20.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.462+0000 7fa6fedc3700 1 Processor -- start 2023-03-06T14:16:20.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.462+0000 7fa6fedc3700 1 -- start start 2023-03-06T14:16:20.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7fd56c931700 1 --2- 172.21.15.3:0/1354518168 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5680b6e30 0x7fd5681ec6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7fd56d933700 1 -- 172.21.15.3:0/1354518168 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5680b6e30 msgr2=0x7fd5681ec6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7fd56d933700 1 --2- 172.21.15.3:0/1354518168 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5680b6e30 0x7fd5681ec6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7fd56d933700 1 -- 172.21.15.3:0/1354518168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5680b69e0 msgr2=0x7fd568147780 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-06T14:16:20.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7fd56d933700 1 --2- 172.21.15.3:0/1354518168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5680b69e0 0x7fd568147780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7fd56d933700 1 -- 172.21.15.3:0/1354518168 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd560009a70 con 0x7fd5681488d0 2023-03-06T14:16:20.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7fd56c931700 1 --2- 172.21.15.3:0/1354518168 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5680b6e30 0x7fd5681ec6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:16:20.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7fd56d933700 1 --2- 172.21.15.3:0/1354518168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5681488d0 0x7fd56813a0c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd55800c820 tx=0x7fd55800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7f474ad46700 1 -- 172.21.15.3:0/970383588 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4744157070 msgr2=0x7f4744072110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7f474ad46700 1 --2- 172.21.15.3:0/970383588 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4744157070 0x7f4744072110 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f474408ad50 tx=0x7f473c00b330 comp rx=0 tx=0).stop 2023-03-06T14:16:20.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7f474ad46700 1 -- 172.21.15.3:0/970383588 shutdown_connections 2023-03-06T14:16:20.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7f474ad46700 1 --2- 172.21.15.3:0/970383588 >> v2:172.21.15.3:3300/0 conn(0x7f47440be8a0 0x7f4744072650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7f474ad46700 1 --2- 172.21.15.3:0/970383588 >> v2:172.21.15.136:3300/0 conn(0x7f4744156ca0 0x7f47440be360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7f474ad46700 1 --2- 172.21.15.3:0/970383588 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4744157070 0x7f4744072110 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7f474ad46700 1 -- 172.21.15.3:0/970383588 >> 172.21.15.3:0/970383588 conn(0x7f47440c53d0 msgr2=0x7f47440c57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7f474ad46700 1 -- 172.21.15.3:0/970383588 shutdown_connections 2023-03-06T14:16:20.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.460+0000 7f0a68c33700 1 Processor -- start 2023-03-06T14:16:20.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7f0a68c33700 1 -- start start 2023-03-06T14:16:20.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7f0a68c33700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a6406fde0 0x7f0a640a8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7f0a68c33700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a640bf040 0x7f0a640b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.462+0000 7f0a68c33700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a640c1fe0 0x7f0a6414c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.462+0000 7f0a68c33700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6414b4c0 con 0x7f0a6406fde0 2023-03-06T14:16:20.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.462+0000 7f0a68c33700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a640a44b0 con 0x7f0a640c1fe0 2023-03-06T14:16:20.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.462+0000 7f0a68c33700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a640a4a70 con 0x7f0a640bf040 2023-03-06T14:16:20.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.462+0000 7f0a6259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a6406fde0 0x7f0a640a8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.462+0000 7f0a6259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a6406fde0 0x7f0a640a8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56278/0 (socket says 172.21.15.3:56278) 2023-03-06T14:16:20.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.462+0000 7f0a6259c700 1 -- 172.21.15.3:0/2026676346 learned_addr learned my addr 172.21.15.3:0/2026676346 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.462+0000 7f0a62d9d700 1 --2- 172.21.15.3:0/2026676346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a640c1fe0 0x7f0a6414c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.462+0000 7f0a6259c700 1 -- 172.21.15.3:0/2026676346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a640bf040 msgr2=0x7f0a640b7e00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-06T14:16:20.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.462+0000 7f0a6259c700 1 --2- 172.21.15.3:0/2026676346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a640bf040 0x7f0a640b7e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.462+0000 7f0a6259c700 1 -- 172.21.15.3:0/2026676346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a640c1fe0 msgr2=0x7f0a6414c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.462+0000 7f0a6259c700 1 --2- 172.21.15.3:0/2026676346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a640c1fe0 0x7f0a6414c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.462+0000 7f0a6259c700 1 -- 172.21.15.3:0/2026676346 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a580094a0 con 0x7f0a6406fde0 2023-03-06T14:16:20.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.462+0000 7f0a6259c700 1 --2- 172.21.15.3:0/2026676346 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a6406fde0 0x7f0a640a8870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400e810 tx=0x7f0a5400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7fd5deffd700 1 --2- 172.21.15.3:0/4237219533 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fd5cc0683c0 0x7fd5cc06a870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009c10 tx=0x7fd5d4010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.463+0000 7f9e86ab0700 1 Processor -- start 2023-03-06T14:16:20.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.463+0000 7f9e86ab0700 1 -- start start 2023-03-06T14:16:20.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.461+0000 7f474ad46700 1 -- 172.21.15.3:0/970383588 wait complete. 2023-03-06T14:16:20.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.463+0000 7f474ad46700 1 Processor -- start 2023-03-06T14:16:20.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.463+0000 7f474ad46700 1 -- start start 2023-03-06T14:16:20.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7fa6fedc3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa6f80b6530 0x7fa6f815e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7fa6fedc3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6f80b7a40 0x7fa6f81f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7fa6fedc3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa6f815fc50 0x7fa6f81f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7fa6fedc3700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80b8c00 con 0x7fa6f815fc50 2023-03-06T14:16:20.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7fa6fedc3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80b8640 con 0x7fa6f80b7a40 2023-03-06T14:16:20.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7fa6fedc3700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f815ed00 con 0x7fa6f80b6530 2023-03-06T14:16:20.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7fa6fd360700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa6f815fc50 0x7fa6f81f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7fa6fd360700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa6f815fc50 0x7fa6f81f54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56286/0 (socket says 172.21.15.3:56286) 2023-03-06T14:16:20.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7fa6fd360700 1 -- 172.21.15.3:0/1178875813 learned_addr learned my addr 172.21.15.3:0/1178875813 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7fa6fd360700 1 -- 172.21.15.3:0/1178875813 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa6f80b6530 msgr2=0x7fa6f815e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7fa6fcb5f700 1 --2- 172.21.15.3:0/1178875813 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa6f80b6530 0x7fa6f815e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7f474ad46700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47440be8a0 0x7f47440c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7f474ad46700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4744156ca0 0x7f47440bfc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7f474ad46700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4744157070 0x7f47441308f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7f474ad46700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47441394f0 con 0x7f4744156ca0 2023-03-06T14:16:20.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7f474ad46700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47441497f0 con 0x7f4744157070 2023-03-06T14:16:20.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7f474ad46700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4744133f30 con 0x7f47440be8a0 2023-03-06T14:16:20.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7f9e86ab0700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9e80150700 0x7f9e80150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7f9e86ab0700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e8006ec00 0x7f9e800bcf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7f9e86ab0700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e800bd470 con 0x7f9e800bbdc0 2023-03-06T14:16:20.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7f9e86ab0700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8006d270 con 0x7f9e80150700 2023-03-06T14:16:20.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7f9e86ab0700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e80072390 con 0x7f9e8006ec00 2023-03-06T14:16:20.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7fa6f7fff700 1 --2- 172.21.15.3:0/1178875813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6f80b7a40 0x7fa6f81f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.464+0000 7fa6fd360700 1 --2- 172.21.15.3:0/1178875813 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa6f80b6530 0x7fa6f815e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7f9e7ffff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e8006ec00 0x7f9e800bcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7f4743fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4744156ca0 0x7f47440bfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7f4743fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4744156ca0 0x7f47440bfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56300/0 (socket says 172.21.15.3:56300) 2023-03-06T14:16:20.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7f4743fff700 1 -- 172.21.15.3:0/1599944945 learned_addr learned my addr 172.21.15.3:0/1599944945 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7f4748ae2700 1 --2- 172.21.15.3:0/1599944945 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47440be8a0 0x7f47440c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7f9e7ffff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e8006ec00 0x7f9e800bcf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.3:49274/0 (socket says 172.21.15.3:49274) 2023-03-06T14:16:20.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7f9e7ffff700 1 -- 172.21.15.3:0/2305205023 learned_addr learned my addr 172.21.15.3:0/2305205023 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7fa6fd360700 1 -- 172.21.15.3:0/1178875813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6f80b7a40 msgr2=0x7fa6f81f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7fa6fd360700 1 --2- 172.21.15.3:0/1178875813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6f80b7a40 0x7fa6f81f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7fa6fd360700 1 -- 172.21.15.3:0/1178875813 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ec00b0d0 con 0x7fa6f815fc50 2023-03-06T14:16:20.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7fa6fcb5f700 1 --2- 172.21.15.3:0/1178875813 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa6f80b6530 0x7fa6f815e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:16:20.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7fa6f7fff700 1 --2- 172.21.15.3:0/1178875813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6f80b7a40 0x7fa6f81f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:16:20.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7f4743fff700 1 -- 172.21.15.3:0/1599944945 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47440be8a0 msgr2=0x7f47440c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7f4743fff700 1 --2- 172.21.15.3:0/1599944945 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47440be8a0 0x7f47440c1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7f4743fff700 1 -- 172.21.15.3:0/1599944945 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4744157070 msgr2=0x7f47441308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7f4743fff700 1 --2- 172.21.15.3:0/1599944945 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4744157070 0x7f47441308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7f4743fff700 1 -- 172.21.15.3:0/1599944945 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c009b30 con 0x7f4744156ca0 2023-03-06T14:16:20.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7fa6fd360700 1 --2- 172.21.15.3:0/1178875813 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa6f815fc50 0x7fa6f81f54e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa6f000c760 tx=0x7fa6f000cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7f4743fff700 1 --2- 172.21.15.3:0/1599944945 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4744156ca0 0x7f47440bfc50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f473c012000 tx=0x7f473c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7f9e7ffff700 1 -- 172.21.15.3:0/2305205023 >> v2:172.21.15.136:3300/0 conn(0x7f9e80150700 msgr2=0x7f9e80150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:20.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7f9e7ffff700 1 --2- 172.21.15.3:0/2305205023 >> v2:172.21.15.136:3300/0 conn(0x7f9e80150700 0x7f9e80150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7f9e7ffff700 1 -- 172.21.15.3:0/2305205023 >> v1:172.21.15.136:6789/0 conn(0x7f9e800bbdc0 legacy=0x7f9e800716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7f9e7ffff700 1 -- 172.21.15.3:0/2305205023 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e801510f0 con 0x7f9e8006ec00 2023-03-06T14:16:20.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7f9e7ffff700 1 --2- 172.21.15.3:0/2305205023 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e8006ec00 0x7f9e800bcf30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009e50 tx=0x7f9e7800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcdcf6b26a201a23 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.465+0000 7f9e7f7fe700 1 -- 172.21.15.3:0/2305205023 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7800e070 con 0x7f9e8006ec00 2023-03-06T14:16:20.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.466+0000 7f9e7f7fe700 1 -- 172.21.15.3:0/2305205023 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7800b9c0 con 0x7f9e8006ec00 2023-03-06T14:16:20.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.466+0000 7f9e7f7fe700 1 -- 172.21.15.3:0/2305205023 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7800bd50 con 0x7f9e8006ec00 2023-03-06T14:16:20.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.466+0000 7f9e86ab0700 1 -- 172.21.15.3:0/2305205023 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e8006ec00 msgr2=0x7f9e800bcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.466+0000 7f9e86ab0700 1 --2- 172.21.15.3:0/2305205023 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e8006ec00 0x7f9e800bcf30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009e50 tx=0x7f9e7800b330 comp rx=0 tx=0).stop 2023-03-06T14:16:20.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.466+0000 7f9e86ab0700 1 -- 172.21.15.3:0/2305205023 shutdown_connections 2023-03-06T14:16:20.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.466+0000 7f9e86ab0700 1 --2- 172.21.15.3:0/2305205023 >> v2:172.21.15.136:3300/0 conn(0x7f9e80150700 0x7f9e80150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.466+0000 7f9e86ab0700 1 --2- 172.21.15.3:0/2305205023 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e8006ec00 0x7f9e800bcf30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.466+0000 7f9e86ab0700 1 -- 172.21.15.3:0/2305205023 >> 172.21.15.3:0/2305205023 conn(0x7f9e800c1b40 msgr2=0x7f9e8006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.466+0000 7f9e86ab0700 1 -- 172.21.15.3:0/2305205023 shutdown_connections 2023-03-06T14:16:20.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.466+0000 7f9e86ab0700 1 -- 172.21.15.3:0/2305205023 wait complete. 2023-03-06T14:16:20.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.467+0000 7f3ca959a700 1 -- 172.21.15.3:0/4291454140 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4004230 con 0x7f3cac072820 2023-03-06T14:16:20.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.467+0000 7f3ca959a700 1 -- 172.21.15.3:0/4291454140 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca4004390 con 0x7f3cac072820 2023-03-06T14:16:20.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.467+0000 7f3ca959a700 1 -- 172.21.15.3:0/4291454140 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40036a0 con 0x7f3cac072820 2023-03-06T14:16:20.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.467+0000 7fd5c77fe700 1 -- 172.21.15.3:0/4237219533 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd5d0015020 con 0x7fd5e00b69e0 2023-03-06T14:16:20.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.467+0000 7f47417fa700 1 -- 172.21.15.3:0/1599944945 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c0092e0 con 0x7f4744156ca0 2023-03-06T14:16:20.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.467+0000 7f47417fa700 1 -- 172.21.15.3:0/1599944945 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473c004250 con 0x7f4744156ca0 2023-03-06T14:16:20.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.467+0000 7f47417fa700 1 -- 172.21.15.3:0/1599944945 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c0045e0 con 0x7f4744156ca0 2023-03-06T14:16:20.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.467+0000 7fa6f57fa700 1 -- 172.21.15.3:0/1178875813 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0003e30 con 0x7fa6f815fc50 2023-03-06T14:16:20.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.467+0000 7fa6fedc3700 1 -- 172.21.15.3:0/1178875813 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f8070f60 con 0x7fa6f815fc50 2023-03-06T14:16:20.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.468+0000 7fa6fedc3700 1 -- 172.21.15.3:0/1178875813 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f806eaa0 con 0x7fa6f815fc50 2023-03-06T14:16:20.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.469+0000 7fa6fedc3700 1 -- 172.21.15.3:0/1178875813 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f80bba20 con 0x7fa6f815fc50 2023-03-06T14:16:20.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.467+0000 7fd55dffb700 1 -- 172.21.15.3:0/1354518168 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558004220 con 0x7fd5681488d0 2023-03-06T14:16:20.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.468+0000 7fd55dffb700 1 -- 172.21.15.3:0/1354518168 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd558004380 con 0x7fd5681488d0 2023-03-06T14:16:20.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.468+0000 7fd56f396700 1 -- 172.21.15.3:0/1354518168 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56814bc20 con 0x7fd5681488d0 2023-03-06T14:16:20.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.468+0000 7fd56f396700 1 -- 172.21.15.3:0/1354518168 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5680bd580 con 0x7fd5681488d0 2023-03-06T14:16:20.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.469+0000 7fd55dffb700 1 -- 172.21.15.3:0/1354518168 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5580036a0 con 0x7fd5681488d0 2023-03-06T14:16:20.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.471+0000 7fd56f396700 1 -- 172.21.15.3:0/1354518168 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5480052e0 con 0x7fd5681488d0 2023-03-06T14:16:20.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.468+0000 7f474ad46700 1 -- 172.21.15.3:0/1599944945 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47440bc7d0 con 0x7f4744156ca0 2023-03-06T14:16:20.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.468+0000 7f474ad46700 1 -- 172.21.15.3:0/1599944945 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47440c6220 con 0x7f4744156ca0 2023-03-06T14:16:20.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.470+0000 7f474ad46700 1 -- 172.21.15.3:0/1599944945 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4744157550 con 0x7f4744156ca0 2023-03-06T14:16:20.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.468+0000 7f9e86ab0700 1 Processor -- start 2023-03-06T14:16:20.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.468+0000 7f9e86ab0700 1 -- start start 2023-03-06T14:16:20.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.469+0000 7f9e86ab0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9e8006ec00 0x7f9e80147660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.469+0000 7f9e86ab0700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e800bbdc0 0x7f9e800b6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.469+0000 7f9e86ab0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e80150700 0x7f9e800b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.469+0000 7f9e86ab0700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8014f910 con 0x7f9e8006ec00 2023-03-06T14:16:20.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.469+0000 7f9e86ab0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8013ada0 con 0x7f9e80150700 2023-03-06T14:16:20.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.469+0000 7f9e86ab0700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e801423d0 con 0x7f9e800bbdc0 2023-03-06T14:16:20.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.470+0000 7f9e7ffff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e800bbdc0 0x7f9e800b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.470+0000 7f9e7ffff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e800bbdc0 0x7f9e800b6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.3:49282/0 (socket says 172.21.15.3:49282) 2023-03-06T14:16:20.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.470+0000 7f9e7ffff700 1 -- 172.21.15.3:0/3379002730 learned_addr learned my addr 172.21.15.3:0/3379002730 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.470+0000 7f9e8504d700 1 --2- 172.21.15.3:0/3379002730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e80150700 0x7f9e800b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.470+0000 7f9e8484c700 1 --2- 172.21.15.3:0/3379002730 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9e8006ec00 0x7f9e80147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.470+0000 7f9e7ffff700 1 -- 172.21.15.3:0/3379002730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e80150700 msgr2=0x7f9e800b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.470+0000 7f9e7ffff700 1 --2- 172.21.15.3:0/3379002730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e80150700 0x7f9e800b6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.470+0000 7f9e7ffff700 1 -- 172.21.15.3:0/3379002730 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9e8006ec00 msgr2=0x7f9e80147660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.470+0000 7f9e7ffff700 1 --2- 172.21.15.3:0/3379002730 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9e8006ec00 0x7f9e80147660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.470+0000 7f9e7ffff700 1 -- 172.21.15.3:0/3379002730 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e78009b30 con 0x7f9e800bbdc0 2023-03-06T14:16:20.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.470+0000 7f9e7ffff700 1 --2- 172.21.15.3:0/3379002730 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e800bbdc0 0x7f9e800b6570 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9e78000f80 tx=0x7f9e78004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.471+0000 7f9e7d7fa700 1 -- 172.21.15.3:0/3379002730 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e780048f0 con 0x7f9e800bbdc0 2023-03-06T14:16:20.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.471+0000 7f9e7d7fa700 1 -- 172.21.15.3:0/3379002730 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e780094d0 con 0x7f9e800bbdc0 2023-03-06T14:16:20.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.471+0000 7f9e7d7fa700 1 -- 172.21.15.3:0/3379002730 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7801c660 con 0x7f9e800bbdc0 2023-03-06T14:16:20.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.468+0000 7f3cb0ce5700 1 -- 172.21.15.3:0/4291454140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cac072820 msgr2=0x7f3cac155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.468+0000 7f3cb0ce5700 1 --2- 172.21.15.3:0/4291454140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cac072820 0x7f3cac155bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3cac08ad50 tx=0x7f3ca4009b20 comp rx=0 tx=0).stop 2023-03-06T14:16:20.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.469+0000 7f3cb0ce5700 1 -- 172.21.15.3:0/4291454140 shutdown_connections 2023-03-06T14:16:20.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.469+0000 7f3cb0ce5700 1 --2- 172.21.15.3:0/4291454140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cac072820 0x7f3cac155bf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.469+0000 7f3cb0ce5700 1 --2- 172.21.15.3:0/4291454140 >> v2:172.21.15.136:3300/0 conn(0x7f3cac156ca0 0x7f3cac0be360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.469+0000 7f3cb0ce5700 1 -- 172.21.15.3:0/4291454140 >> 172.21.15.3:0/4291454140 conn(0x7f3cac0c53d0 msgr2=0x7f3cac0c57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.471+0000 7f3cb0ce5700 1 -- 172.21.15.3:0/4291454140 shutdown_connections 2023-03-06T14:16:20.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.471+0000 7fd55dffb700 1 -- 172.21.15.3:0/1354518168 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd558020070 con 0x7fd5681488d0 2023-03-06T14:16:20.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.471+0000 7fd55dffb700 1 --2- 172.21.15.3:0/1354518168 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fd54c068340 0x7fd54c06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.472+0000 7fd55dffb700 1 -- 172.21.15.3:0/1354518168 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd558085960 con 0x7fd5681488d0 2023-03-06T14:16:20.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.471+0000 7f9e86ab0700 1 -- 172.21.15.3:0/3379002730 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8006ccb0 con 0x7f9e800bbdc0 2023-03-06T14:16:20.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.471+0000 7f9e86ab0700 1 -- 172.21.15.3:0/3379002730 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e801513d0 con 0x7f9e800bbdc0 2023-03-06T14:16:20.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.471+0000 7f0a52ffd700 1 -- 172.21.15.3:0/2026676346 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54013610 con 0x7f0a6406fde0 2023-03-06T14:16:20.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.471+0000 7f0a52ffd700 1 -- 172.21.15.3:0/2026676346 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a54013770 con 0x7f0a6406fde0 2023-03-06T14:16:20.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.471+0000 7f0a52ffd700 1 -- 172.21.15.3:0/2026676346 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54013b00 con 0x7f0a6406fde0 2023-03-06T14:16:20.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.471+0000 7f3cb0ce5700 1 -- 172.21.15.3:0/4291454140 wait complete. 2023-03-06T14:16:20.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.473+0000 7f3cb0ce5700 1 Processor -- start 2023-03-06T14:16:20.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.472+0000 7f0a68c33700 1 -- 172.21.15.3:0/2026676346 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a640bf9f0 con 0x7f0a6406fde0 2023-03-06T14:16:20.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.472+0000 7f0a68c33700 1 -- 172.21.15.3:0/2026676346 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a640c2600 con 0x7f0a6406fde0 2023-03-06T14:16:20.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.474+0000 7f0a68c33700 1 -- 172.21.15.3:0/2026676346 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a480052e0 con 0x7f0a6406fde0 2023-03-06T14:16:20.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.473+0000 7f9e7d7fa700 1 -- 172.21.15.3:0/3379002730 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9e78022030 con 0x7f9e800bbdc0 2023-03-06T14:16:20.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.474+0000 7f9e7d7fa700 1 --2- 172.21.15.3:0/3379002730 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f9e6c068340 0x7f9e6c06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.474+0000 7f9e7d7fa700 1 -- 172.21.15.3:0/3379002730 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9e78087900 con 0x7f9e800bbdc0 2023-03-06T14:16:20.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.474+0000 7f47417fa700 1 -- 172.21.15.3:0/1599944945 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f473c02c070 con 0x7f4744156ca0 2023-03-06T14:16:20.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.473+0000 7f3cb0ce5700 1 -- start start 2023-03-06T14:16:20.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.474+0000 7f3cb0ce5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cac072820 0x7f3cac14fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.474+0000 7f3cb0ce5700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3cac156ca0 0x7f3cac1469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.474+0000 7f3cb0ce5700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cac157070 0x7f3cac146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.474+0000 7f3cb0ce5700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac13f850 con 0x7f3cac157070 2023-03-06T14:16:20.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.474+0000 7f3cb0ce5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac14cff0 con 0x7f3cac072820 2023-03-06T14:16:20.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.474+0000 7f3cb0ce5700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac0b8260 con 0x7f3cac156ca0 2023-03-06T14:16:20.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.474+0000 7f47417fa700 1 --2- 172.21.15.3:0/1599944945 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f47300682f0 0x7f473006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.474+0000 7f9e8484c700 1 --2- 172.21.15.3:0/3379002730 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f9e6c068340 0x7f9e6c06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.474+0000 7f3ca9d9b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3cac156ca0 0x7f3cac1469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.474+0000 7f3caad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cac157070 0x7f3cac146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.474+0000 7f3caad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cac157070 0x7f3cac146f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56312/0 (socket says 172.21.15.3:56312) 2023-03-06T14:16:20.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.474+0000 7f3caad9d700 1 -- 172.21.15.3:0/1826804158 learned_addr learned my addr 172.21.15.3:0/1826804158 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:20.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.475+0000 7f47417fa700 1 -- 172.21.15.3:0/1599944945 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f473c087ca0 con 0x7f4744156ca0 2023-03-06T14:16:20.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.475+0000 7f3caad9d700 1 -- 172.21.15.3:0/1826804158 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3cac156ca0 msgr2=0x7f3cac1469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.475+0000 7f3caad9d700 1 --2- 172.21.15.3:0/1826804158 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3cac156ca0 0x7f3cac1469c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.475+0000 7f3caad9d700 1 -- 172.21.15.3:0/1826804158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cac072820 msgr2=0x7f3cac14fdf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-06T14:16:20.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.475+0000 7f3caad9d700 1 --2- 172.21.15.3:0/1826804158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cac072820 0x7f3cac14fdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.475+0000 7f3caad9d700 1 -- 172.21.15.3:0/1826804158 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca40094a0 con 0x7f3cac157070 2023-03-06T14:16:20.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.475+0000 7f9e8484c700 1 --2- 172.21.15.3:0/3379002730 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f9e6c068340 0x7f9e6c06a7f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9e74006fd0 tx=0x7f9e74008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.475+0000 7f3caad9d700 1 --2- 172.21.15.3:0/1826804158 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cac157070 0x7f3cac146f00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4009e70 tx=0x7f3ca4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.476+0000 7fd56d132700 1 --2- 172.21.15.3:0/1354518168 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fd54c068340 0x7fd54c06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.476+0000 7fd56d132700 1 --2- 172.21.15.3:0/1354518168 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fd54c068340 0x7fd54c06a7f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd56000b370 tx=0x7fd560011000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.478+0000 7f4748ae2700 1 --2- 172.21.15.3:0/1599944945 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f47300682f0 0x7f473006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.478+0000 7f4748ae2700 1 --2- 172.21.15.3:0/1599944945 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f47300682f0 0x7f473006a7a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f473400a990 tx=0x7f4734008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.479+0000 7f47417fa700 1 -- 172.21.15.3:0/1599944945 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f473c054120 con 0x7f4744156ca0 2023-03-06T14:16:20.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.480+0000 7f3c9affd700 1 -- 172.21.15.3:0/1826804158 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40107b0 con 0x7f3cac157070 2023-03-06T14:16:20.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.480+0000 7f3cb0ce5700 1 -- 172.21.15.3:0/1826804158 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cac0bc7d0 con 0x7f3cac157070 2023-03-06T14:16:20.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.480+0000 7f3cb0ce5700 1 -- 172.21.15.3:0/1826804158 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cac0c6220 con 0x7f3cac157070 2023-03-06T14:16:20.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.481+0000 7fa6f57fa700 1 -- 172.21.15.3:0/1178875813 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f0005070 con 0x7fa6f815fc50 2023-03-06T14:16:20.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.481+0000 7fa6f57fa700 1 -- 172.21.15.3:0/1178875813 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0005400 con 0x7fa6f815fc50 2023-03-06T14:16:20.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.481+0000 7fa6f57fa700 1 -- 172.21.15.3:0/1178875813 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa6f0010070 con 0x7fa6f815fc50 2023-03-06T14:16:20.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.481+0000 7f3cb0ce5700 1 -- 172.21.15.3:0/1826804158 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cac157550 con 0x7f3cac157070 2023-03-06T14:16:20.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.481+0000 7fa6f57fa700 1 --2- 172.21.15.3:0/1178875813 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa6dc0682f0 0x7fa6dc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.482+0000 7fa6fcb5f700 1 --2- 172.21.15.3:0/1178875813 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa6dc0682f0 0x7fa6dc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.482+0000 7fa6fcb5f700 1 --2- 172.21.15.3:0/1178875813 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa6dc0682f0 0x7fa6dc06a7a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4000f60 tx=0x7fa6e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.489+0000 7fd55dffb700 1 -- 172.21.15.3:0/1354518168 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd5580559a0 con 0x7fd5681488d0 2023-03-06T14:16:20.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.489+0000 7f3c9affd700 1 -- 172.21.15.3:0/1826804158 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca4010910 con 0x7f3cac157070 2023-03-06T14:16:20.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.489+0000 7f3c9affd700 1 -- 172.21.15.3:0/1826804158 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4010c80 con 0x7f3cac157070 2023-03-06T14:16:20.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.489+0000 7fa6f57fa700 1 -- 172.21.15.3:0/1178875813 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa6f00567e0 con 0x7fa6f815fc50 2023-03-06T14:16:20.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.490+0000 7f9e86ab0700 1 -- 172.21.15.3:0/3379002730 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8006cf90 con 0x7f9e800bbdc0 2023-03-06T14:16:20.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.490+0000 7f0a52ffd700 1 -- 172.21.15.3:0/2026676346 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0a54023070 con 0x7f0a6406fde0 2023-03-06T14:16:20.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.491+0000 7f0a52ffd700 1 --2- 172.21.15.3:0/2026676346 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0a44068340 0x7f0a4406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.491+0000 7f0a52ffd700 1 -- 172.21.15.3:0/2026676346 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0a54085fe0 con 0x7f0a6406fde0 2023-03-06T14:16:20.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.491+0000 7f0a61d9b700 1 --2- 172.21.15.3:0/2026676346 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0a44068340 0x7f0a4406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.491+0000 7f0a61d9b700 1 --2- 172.21.15.3:0/2026676346 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0a44068340 0x7f0a4406a7f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0a6414f890 tx=0x7f0a58008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.495+0000 7f9e7d7fa700 1 -- 172.21.15.3:0/3379002730 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9e78053f10 con 0x7f9e800bbdc0 2023-03-06T14:16:20.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.498+0000 7fa6f57fa700 1 -- 172.21.15.3:0/1178875813 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa6f0052b80 con 0x7fa6f815fc50 2023-03-06T14:16:20.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.502+0000 7f3c9affd700 1 -- 172.21.15.3:0/1826804158 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3ca402d070 con 0x7f3cac157070 2023-03-06T14:16:20.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.502+0000 7f3c9affd700 1 --2- 172.21.15.3:0/1826804158 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3c8c0682f0 0x7f3c8c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:20.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.503+0000 7f3caa59c700 1 --2- 172.21.15.3:0/1826804158 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3c8c0682f0 0x7f3c8c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:20.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.503+0000 7f3caa59c700 1 --2- 172.21.15.3:0/1826804158 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3c8c0682f0 0x7f3c8c06a7a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009a70 tx=0x7f3ca0009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:20.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.510+0000 7f3c9affd700 1 -- 172.21.15.3:0/1826804158 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3ca4057ba0 con 0x7f3cac157070 2023-03-06T14:16:20.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.510+0000 7f0a52ffd700 1 -- 172.21.15.3:0/2026676346 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0a54052570 con 0x7f0a6406fde0 2023-03-06T14:16:20.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.517+0000 7f3c9affd700 1 -- 172.21.15.3:0/1826804158 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3ca4053f40 con 0x7f3cac157070 2023-03-06T14:16:20.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.840+0000 7fd991527700 1 -- 172.21.15.3:0/3223038832 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd98c04e6e0 con 0x7fd98c14ec90 2023-03-06T14:16:20.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.840+0000 7fd9737fe700 1 -- 172.21.15.3:0/3223038832 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd9840566f0 con 0x7fd98c14ec90 2023-03-06T14:16:20.845 INFO:teuthology.orchestra.run.smithi003.stdout:55834574856 2023-03-06T14:16:20.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.844+0000 7fd991527700 1 -- 172.21.15.3:0/3223038832 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fd974068520 msgr2=0x7fd97406a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.844+0000 7fd991527700 1 --2- 172.21.15.3:0/3223038832 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fd974068520 0x7fd97406a9d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd97c000f60 tx=0x7fd97c007a40 comp rx=0 tx=0).stop 2023-03-06T14:16:20.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.844+0000 7fd991527700 1 -- 172.21.15.3:0/3223038832 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd98c14ec90 msgr2=0x7fd98c1ec2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.844+0000 7fd991527700 1 --2- 172.21.15.3:0/3223038832 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd98c14ec90 0x7fd98c1ec2b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd984009d30 tx=0x7fd98400c3a0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.845+0000 7fd991527700 1 -- 172.21.15.3:0/3223038832 shutdown_connections 2023-03-06T14:16:20.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.845+0000 7fd991527700 1 --2- 172.21.15.3:0/3223038832 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fd974068520 0x7fd97406a9d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.845+0000 7fd991527700 1 --2- 172.21.15.3:0/3223038832 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd98c14ec90 0x7fd98c1ec2b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.845+0000 7fd991527700 1 --2- 172.21.15.3:0/3223038832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd98c06c810 0x7fd98c1411a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.845+0000 7fd991527700 1 --2- 172.21.15.3:0/3223038832 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd98c0bd320 0x7fd98c1ebd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.845+0000 7fd991527700 1 -- 172.21.15.3:0/3223038832 >> 172.21.15.3:0/3223038832 conn(0x7fd98c0c0eb0 msgr2=0x7fd98c0bc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.845+0000 7fd991527700 1 -- 172.21.15.3:0/3223038832 shutdown_connections 2023-03-06T14:16:20.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.845+0000 7fd991527700 1 -- 172.21.15.3:0/3223038832 wait complete. 2023-03-06T14:16:20.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.1 2023-03-06T14:16:20.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.869+0000 7fd5e539a700 1 -- 172.21.15.3:0/4237219533 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd5e0149000 con 0x7fd5e00b69e0 2023-03-06T14:16:20.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.870+0000 7fd5c77fe700 1 -- 172.21.15.3:0/4237219533 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd5d0052490 con 0x7fd5e00b69e0 2023-03-06T14:16:20.875 INFO:teuthology.orchestra.run.smithi003.stdout:55834574856 2023-03-06T14:16:20.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.877+0000 7fd5e539a700 1 -- 172.21.15.3:0/4237219533 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fd5cc0683c0 msgr2=0x7fd5cc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.877+0000 7fd5e539a700 1 --2- 172.21.15.3:0/4237219533 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fd5cc0683c0 0x7fd5cc06a870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009c10 tx=0x7fd5d4010000 comp rx=0 tx=0).stop 2023-03-06T14:16:20.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.877+0000 7fd5e539a700 1 -- 172.21.15.3:0/4237219533 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5e00b69e0 msgr2=0x7fd5e014a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.877+0000 7fd5e539a700 1 --2- 172.21.15.3:0/4237219533 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5e00b69e0 0x7fd5e014a420 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000b580 tx=0x7fd5d000b940 comp rx=0 tx=0).stop 2023-03-06T14:16:20.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.878+0000 7fd5e539a700 1 -- 172.21.15.3:0/4237219533 shutdown_connections 2023-03-06T14:16:20.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.878+0000 7fd5e539a700 1 --2- 172.21.15.3:0/4237219533 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fd5cc0683c0 0x7fd5cc06a870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.878+0000 7fd5e539a700 1 --2- 172.21.15.3:0/4237219533 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5e01488d0 0x7fd5e0139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.878+0000 7fd5e539a700 1 --2- 172.21.15.3:0/4237219533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5e00704b0 0x7fd5e01ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.878+0000 7fd5e539a700 1 --2- 172.21.15.3:0/4237219533 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5e00b69e0 0x7fd5e014a420 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.878+0000 7fd5e539a700 1 -- 172.21.15.3:0/4237219533 >> 172.21.15.3:0/4237219533 conn(0x7fd5e00c1b40 msgr2=0x7fd5e0143320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.878+0000 7fd5e539a700 1 -- 172.21.15.3:0/4237219533 shutdown_connections 2023-03-06T14:16:20.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.879+0000 7f474ad46700 1 -- 172.21.15.3:0/1599944945 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4744149990 con 0x7f4744156ca0 2023-03-06T14:16:20.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.879+0000 7fd5e539a700 1 -- 172.21.15.3:0/4237219533 wait complete. 2023-03-06T14:16:20.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.879+0000 7f47417fa700 1 -- 172.21.15.3:0/1599944945 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f473c020020 con 0x7f4744156ca0 2023-03-06T14:16:20.881 INFO:teuthology.orchestra.run.smithi003.stdout:55834574857 2023-03-06T14:16:20.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.881+0000 7f474ad46700 1 -- 172.21.15.3:0/1599944945 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f47300682f0 msgr2=0x7f473006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.881+0000 7f474ad46700 1 --2- 172.21.15.3:0/1599944945 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f47300682f0 0x7f473006a7a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f473400a990 tx=0x7f4734008040 comp rx=0 tx=0).stop 2023-03-06T14:16:20.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.881+0000 7f474ad46700 1 -- 172.21.15.3:0/1599944945 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4744156ca0 msgr2=0x7f47440bfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.881+0000 7f474ad46700 1 --2- 172.21.15.3:0/1599944945 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4744156ca0 0x7f47440bfc50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f473c012000 tx=0x7f473c004ad0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.881+0000 7f474ad46700 1 -- 172.21.15.3:0/1599944945 shutdown_connections 2023-03-06T14:16:20.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.881+0000 7f474ad46700 1 --2- 172.21.15.3:0/1599944945 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f47300682f0 0x7f473006a7a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.881+0000 7f474ad46700 1 --2- 172.21.15.3:0/1599944945 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4744157070 0x7f47441308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.881+0000 7f474ad46700 1 --2- 172.21.15.3:0/1599944945 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47440be8a0 0x7f47440c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.881+0000 7f474ad46700 1 --2- 172.21.15.3:0/1599944945 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4744156ca0 0x7f47440bfc50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.882+0000 7f474ad46700 1 -- 172.21.15.3:0/1599944945 >> 172.21.15.3:0/1599944945 conn(0x7f47440c53d0 msgr2=0x7f474414e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.882+0000 7f474ad46700 1 -- 172.21.15.3:0/1599944945 shutdown_connections 2023-03-06T14:16:20.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.882+0000 7f474ad46700 1 -- 172.21.15.3:0/1599944945 wait complete. 2023-03-06T14:16:20.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.887+0000 7fd56f396700 1 -- 172.21.15.3:0/1354518168 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd548005590 con 0x7fd5681488d0 2023-03-06T14:16:20.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.888+0000 7fd55dffb700 1 -- 172.21.15.3:0/1354518168 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd558055590 con 0x7fd5681488d0 2023-03-06T14:16:20.892 INFO:teuthology.orchestra.run.smithi003.stdout:55834574856 2023-03-06T14:16:20.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.890+0000 7f9e86ab0700 1 -- 172.21.15.3:0/3379002730 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9e800b6ff0 con 0x7f9e800bbdc0 2023-03-06T14:16:20.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.891+0000 7fd56f396700 1 -- 172.21.15.3:0/1354518168 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fd54c068340 msgr2=0x7fd54c06a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.891+0000 7fd56f396700 1 --2- 172.21.15.3:0/1354518168 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fd54c068340 0x7fd54c06a7f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd56000b370 tx=0x7fd560011000 comp rx=0 tx=0).stop 2023-03-06T14:16:20.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.891+0000 7fd56f396700 1 -- 172.21.15.3:0/1354518168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5681488d0 msgr2=0x7fd56813a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.891+0000 7fd56f396700 1 --2- 172.21.15.3:0/1354518168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5681488d0 0x7fd56813a0c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd55800c820 tx=0x7fd55800cbe0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.891+0000 7fd56f396700 1 -- 172.21.15.3:0/1354518168 shutdown_connections 2023-03-06T14:16:20.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.891+0000 7fd56f396700 1 --2- 172.21.15.3:0/1354518168 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fd54c068340 0x7fd54c06a7f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.891+0000 7fd56f396700 1 --2- 172.21.15.3:0/1354518168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5681488d0 0x7fd56813a0c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.891+0000 7fd56f396700 1 --2- 172.21.15.3:0/1354518168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5680b69e0 0x7fd568147780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.891+0000 7fd56f396700 1 --2- 172.21.15.3:0/1354518168 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5680b6e30 0x7fd5681ec6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.891+0000 7fd56f396700 1 -- 172.21.15.3:0/1354518168 >> 172.21.15.3:0/1354518168 conn(0x7fd5680c1b40 msgr2=0x7fd568142640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.891+0000 7fd56f396700 1 -- 172.21.15.3:0/1354518168 shutdown_connections 2023-03-06T14:16:20.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.891+0000 7fd56f396700 1 -- 172.21.15.3:0/1354518168 wait complete. 2023-03-06T14:16:20.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.892+0000 7f9e7d7fa700 1 -- 172.21.15.3:0/3379002730 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9e78057530 con 0x7f9e800bbdc0 2023-03-06T14:16:20.895 INFO:teuthology.orchestra.run.smithi003.stdout:55834574858 2023-03-06T14:16:20.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.895+0000 7f9e86ab0700 1 -- 172.21.15.3:0/3379002730 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f9e6c068340 msgr2=0x7f9e6c06a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.895+0000 7f9e86ab0700 1 --2- 172.21.15.3:0/3379002730 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f9e6c068340 0x7f9e6c06a7f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9e74006fd0 tx=0x7f9e74008040 comp rx=0 tx=0).stop 2023-03-06T14:16:20.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.895+0000 7f9e86ab0700 1 -- 172.21.15.3:0/3379002730 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e800bbdc0 msgr2=0x7f9e800b6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.895+0000 7f9e86ab0700 1 --2- 172.21.15.3:0/3379002730 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e800bbdc0 0x7f9e800b6570 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9e78000f80 tx=0x7f9e78004ad0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.895+0000 7f9e86ab0700 1 -- 172.21.15.3:0/3379002730 shutdown_connections 2023-03-06T14:16:20.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.895+0000 7f9e86ab0700 1 --2- 172.21.15.3:0/3379002730 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f9e6c068340 0x7f9e6c06a7f0 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9e74006fd0 tx=0x7f9e74008040 comp rx=0 tx=0).stop 2023-03-06T14:16:20.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.895+0000 7f9e86ab0700 1 --2- 172.21.15.3:0/3379002730 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9e8006ec00 0x7f9e80147660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.895+0000 7f9e86ab0700 1 --2- 172.21.15.3:0/3379002730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e80150700 0x7f9e800b6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.895+0000 7f9e86ab0700 1 --2- 172.21.15.3:0/3379002730 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e800bbdc0 0x7f9e800b6570 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.895+0000 7f9e86ab0700 1 -- 172.21.15.3:0/3379002730 >> 172.21.15.3:0/3379002730 conn(0x7f9e800c1b40 msgr2=0x7f9e800bf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.896+0000 7fa6fedc3700 1 -- 172.21.15.3:0/1178875813 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa6f804e6e0 con 0x7fa6f815fc50 2023-03-06T14:16:20.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.896+0000 7fa6f57fa700 1 -- 172.21.15.3:0/1178875813 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa6f00561a0 con 0x7fa6f815fc50 2023-03-06T14:16:20.899 INFO:teuthology.orchestra.run.smithi003.stdout:55834574856 2023-03-06T14:16:20.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.897+0000 7f9e86ab0700 1 -- 172.21.15.3:0/3379002730 shutdown_connections 2023-03-06T14:16:20.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.898+0000 7f9e86ab0700 1 -- 172.21.15.3:0/3379002730 wait complete. 2023-03-06T14:16:20.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.899+0000 7fa6fedc3700 1 -- 172.21.15.3:0/1178875813 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa6dc0682f0 msgr2=0x7fa6dc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.899+0000 7fa6fedc3700 1 --2- 172.21.15.3:0/1178875813 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa6dc0682f0 0x7fa6dc06a7a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4000f60 tx=0x7fa6e4009040 comp rx=0 tx=0).stop 2023-03-06T14:16:20.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.899+0000 7fa6fedc3700 1 -- 172.21.15.3:0/1178875813 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa6f815fc50 msgr2=0x7fa6f81f54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.899+0000 7fa6fedc3700 1 --2- 172.21.15.3:0/1178875813 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa6f815fc50 0x7fa6f81f54e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa6f000c760 tx=0x7fa6f000cb20 comp rx=0 tx=0).stop 2023-03-06T14:16:20.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.899+0000 7fa6fedc3700 1 -- 172.21.15.3:0/1178875813 shutdown_connections 2023-03-06T14:16:20.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.899+0000 7fa6fedc3700 1 --2- 172.21.15.3:0/1178875813 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa6dc0682f0 0x7fa6dc06a7a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.899+0000 7fa6fedc3700 1 --2- 172.21.15.3:0/1178875813 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa6f815fc50 0x7fa6f81f54e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.899+0000 7fa6fedc3700 1 --2- 172.21.15.3:0/1178875813 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa6f80b6530 0x7fa6f815e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.899+0000 7fa6fedc3700 1 --2- 172.21.15.3:0/1178875813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6f80b7a40 0x7fa6f81f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.899+0000 7fa6fedc3700 1 -- 172.21.15.3:0/1178875813 >> 172.21.15.3:0/1178875813 conn(0x7fa6f80c1b40 msgr2=0x7fa6f806d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.899+0000 7fa6fedc3700 1 -- 172.21.15.3:0/1178875813 shutdown_connections 2023-03-06T14:16:20.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.899+0000 7fa6fedc3700 1 -- 172.21.15.3:0/1178875813 wait complete. 2023-03-06T14:16:20.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.6 2023-03-06T14:16:20.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.4 2023-03-06T14:16:20.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.905+0000 7f3cb0ce5700 1 -- 172.21.15.3:0/1826804158 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3cac146600 con 0x7f3cac157070 2023-03-06T14:16:20.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.905+0000 7f3c9affd700 1 -- 172.21.15.3:0/1826804158 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ca402b020 con 0x7f3cac157070 2023-03-06T14:16:20.907 INFO:teuthology.orchestra.run.smithi003.stdout:55834574858 2023-03-06T14:16:20.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.908+0000 7f3cb0ce5700 1 -- 172.21.15.3:0/1826804158 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3c8c0682f0 msgr2=0x7f3c8c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.908+0000 7f3cb0ce5700 1 --2- 172.21.15.3:0/1826804158 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3c8c0682f0 0x7f3c8c06a7a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009a70 tx=0x7f3ca0009210 comp rx=0 tx=0).stop 2023-03-06T14:16:20.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.908+0000 7f3cb0ce5700 1 -- 172.21.15.3:0/1826804158 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cac157070 msgr2=0x7f3cac146f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.908+0000 7f3cb0ce5700 1 --2- 172.21.15.3:0/1826804158 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cac157070 0x7f3cac146f00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4009e70 tx=0x7f3ca4004750 comp rx=0 tx=0).stop 2023-03-06T14:16:20.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.908+0000 7f3cb0ce5700 1 -- 172.21.15.3:0/1826804158 shutdown_connections 2023-03-06T14:16:20.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.908+0000 7f3cb0ce5700 1 --2- 172.21.15.3:0/1826804158 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3c8c0682f0 0x7f3c8c06a7a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.908+0000 7f3cb0ce5700 1 --2- 172.21.15.3:0/1826804158 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cac157070 0x7f3cac146f00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.908+0000 7f3cb0ce5700 1 --2- 172.21.15.3:0/1826804158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cac072820 0x7f3cac14fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.908+0000 7f3cb0ce5700 1 --2- 172.21.15.3:0/1826804158 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3cac156ca0 0x7f3cac1469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.908+0000 7f3cb0ce5700 1 -- 172.21.15.3:0/1826804158 >> 172.21.15.3:0/1826804158 conn(0x7f3cac0c53d0 msgr2=0x7f3cac0c31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.909+0000 7f3cb0ce5700 1 -- 172.21.15.3:0/1826804158 shutdown_connections 2023-03-06T14:16:20.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.910+0000 7f3cb0ce5700 1 -- 172.21.15.3:0/1826804158 wait complete. 2023-03-06T14:16:20.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.912+0000 7f0a68c33700 1 -- 172.21.15.3:0/2026676346 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0a48005860 con 0x7f0a6406fde0 2023-03-06T14:16:20.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.913+0000 7f0a52ffd700 1 -- 172.21.15.3:0/2026676346 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0a54021090 con 0x7f0a6406fde0 2023-03-06T14:16:20.915 INFO:teuthology.orchestra.run.smithi003.stdout:55834574857 2023-03-06T14:16:20.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.916+0000 7f0a68c33700 1 -- 172.21.15.3:0/2026676346 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0a44068340 msgr2=0x7f0a4406a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.916+0000 7f0a68c33700 1 --2- 172.21.15.3:0/2026676346 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0a44068340 0x7f0a4406a7f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0a6414f890 tx=0x7f0a58008030 comp rx=0 tx=0).stop 2023-03-06T14:16:20.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.916+0000 7f0a68c33700 1 -- 172.21.15.3:0/2026676346 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a6406fde0 msgr2=0x7f0a640a8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:20.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.916+0000 7f0a68c33700 1 --2- 172.21.15.3:0/2026676346 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a6406fde0 0x7f0a640a8870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400e810 tx=0x7f0a5400eb20 comp rx=0 tx=0).stop 2023-03-06T14:16:20.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.916+0000 7f0a68c33700 1 -- 172.21.15.3:0/2026676346 shutdown_connections 2023-03-06T14:16:20.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.916+0000 7f0a68c33700 1 --2- 172.21.15.3:0/2026676346 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f0a44068340 0x7f0a4406a7f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.916+0000 7f0a68c33700 1 --2- 172.21.15.3:0/2026676346 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a6406fde0 0x7f0a640a8870 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.916+0000 7f0a68c33700 1 --2- 172.21.15.3:0/2026676346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a640c1fe0 0x7f0a6414c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.916+0000 7f0a68c33700 1 --2- 172.21.15.3:0/2026676346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a640bf040 0x7f0a640b7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:20.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.916+0000 7f0a68c33700 1 -- 172.21.15.3:0/2026676346 >> 172.21.15.3:0/2026676346 conn(0x7f0a640c31d0 msgr2=0x7f0a64143b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:20.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.916+0000 7f0a68c33700 1 -- 172.21.15.3:0/2026676346 shutdown_connections 2023-03-06T14:16:20.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:20.916+0000 7f0a68c33700 1 -- 172.21.15.3:0/2026676346 wait complete. 2023-03-06T14:16:20.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.2 2023-03-06T14:16:20.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.7 2023-03-06T14:16:20.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.3 2023-03-06T14:16:20.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.0 2023-03-06T14:16:20.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.5 2023-03-06T14:16:21.866 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-03-06T14:16:21.904 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-03-06T14:16:21.906 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-03-06T14:16:21.921 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-03-06T14:16:21.922 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-03-06T14:16:21.922 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-03-06T14:16:21.928 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-03-06T14:16:21.932 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-03-06T14:16:22.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.059+0000 7f8cdd22c700 1 Processor -- start 2023-03-06T14:16:22.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.059+0000 7f8cdd22c700 1 -- start start 2023-03-06T14:16:22.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.060+0000 7f8cdd22c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8cd81488d0 0x7f8cd80b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.060+0000 7f8cdd22c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cd80b69e0 0x7f8cd80b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.060+0000 7f8cdd22c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8cd814e670 0x7f8cd814ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.060+0000 7f8cdd22c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd80b7610 con 0x7f8cd81488d0 2023-03-06T14:16:22.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.060+0000 7f8cdd22c700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd80bd330 con 0x7f8cd814e670 2023-03-06T14:16:22.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.060+0000 7f8cdd22c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80bbef0 con 0x7f8cd80b69e0 2023-03-06T14:16:22.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.061+0000 7f8cd759e700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8cd814e670 0x7f8cd814ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.061+0000 7f8cd659c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cd80b69e0 0x7f8cd80b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.061+0000 7f8cd6d9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8cd81488d0 0x7f8cd80b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.061+0000 7f8cd6d9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8cd81488d0 0x7f8cd80b5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56326/0 (socket says 172.21.15.3:56326) 2023-03-06T14:16:22.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.061+0000 7f8cd6d9d700 1 -- 172.21.15.3:0/165108285 learned_addr learned my addr 172.21.15.3:0/165108285 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:22.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.062+0000 7f8cd6d9d700 1 -- 172.21.15.3:0/165108285 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cd80b69e0 msgr2=0x7f8cd80b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:22.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.062+0000 7f8cd6d9d700 1 --2- 172.21.15.3:0/165108285 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cd80b69e0 0x7f8cd80b6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.062+0000 7f8cd6d9d700 1 -- 172.21.15.3:0/165108285 >> v2:172.21.15.136:3300/0 conn(0x7f8cd814e670 msgr2=0x7f8cd814ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:22.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.062+0000 7f8cd6d9d700 1 --2- 172.21.15.3:0/165108285 >> v2:172.21.15.136:3300/0 conn(0x7f8cd814e670 0x7f8cd814ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.062+0000 7f8cd6d9d700 1 -- 172.21.15.3:0/165108285 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd80bd580 con 0x7f8cd81488d0 2023-03-06T14:16:22.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.062+0000 7f8cd6d9d700 1 --2- 172.21.15.3:0/165108285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cd81488d0 0x7f8cd80b5eb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8cd806c250 tx=0x7f8cc8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53cccbb405715a96 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.063+0000 7f8cd5d9b700 1 -- 172.21.15.3:0/165108285 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8011830 con 0x7f8cd81488d0 2023-03-06T14:16:22.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.063+0000 7f8cd5d9b700 1 -- 172.21.15.3:0/165108285 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc8011990 con 0x7f8cd81488d0 2023-03-06T14:16:22.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.063+0000 7f8cd5d9b700 1 -- 172.21.15.3:0/165108285 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8011d20 con 0x7f8cd81488d0 2023-03-06T14:16:22.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.064+0000 7f8cdd22c700 1 -- 172.21.15.3:0/165108285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cd81488d0 msgr2=0x7f8cd80b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.064+0000 7f8cdd22c700 1 --2- 172.21.15.3:0/165108285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cd81488d0 0x7f8cd80b5eb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8cd806c250 tx=0x7f8cc8009bd0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.065+0000 7f8cdd22c700 1 -- 172.21.15.3:0/165108285 shutdown_connections 2023-03-06T14:16:22.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.065+0000 7f8cdd22c700 1 --2- 172.21.15.3:0/165108285 >> v2:172.21.15.136:3300/0 conn(0x7f8cd814e670 0x7f8cd814ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.065+0000 7f8cdd22c700 1 --2- 172.21.15.3:0/165108285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cd81488d0 0x7f8cd80b5eb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.065+0000 7f8cdd22c700 1 --2- 172.21.15.3:0/165108285 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cd80b69e0 0x7f8cd80b6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.065+0000 7f8cdd22c700 1 -- 172.21.15.3:0/165108285 >> 172.21.15.3:0/165108285 conn(0x7f8cd80c1b40 msgr2=0x7f8cd806a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:22.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.065+0000 7f8cdd22c700 1 -- 172.21.15.3:0/165108285 shutdown_connections 2023-03-06T14:16:22.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.065+0000 7f8cdd22c700 1 -- 172.21.15.3:0/165108285 wait complete. 2023-03-06T14:16:22.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.068+0000 7f8cdd22c700 1 Processor -- start 2023-03-06T14:16:22.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.068+0000 7f8cdd22c700 1 -- start start 2023-03-06T14:16:22.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.069+0000 7f8cdd22c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cd80b69e0 0x7f8cd81f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.069+0000 7f8cdd22c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cd81488d0 0x7f8cd81e2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.069+0000 7f8cdd22c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cd814e670 0x7f8cd806e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.069+0000 7f8cdd22c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd81f17f0 con 0x7f8cd814e670 2023-03-06T14:16:22.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.069+0000 7f8cdd22c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd81e4560 con 0x7f8cd80b69e0 2023-03-06T14:16:22.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.069+0000 7f8cdd22c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd81f1a90 con 0x7f8cd81488d0 2023-03-06T14:16:22.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.069+0000 7f8cd6d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cd80b69e0 0x7f8cd81f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.069+0000 7f8cd659c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cd81488d0 0x7f8cd81e2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.070+0000 7f8cd759e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cd814e670 0x7f8cd806e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.070+0000 7f8cd759e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cd814e670 0x7f8cd806e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56334/0 (socket says 172.21.15.3:56334) 2023-03-06T14:16:22.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.070+0000 7f8cd759e700 1 -- 172.21.15.3:0/276787131 learned_addr learned my addr 172.21.15.3:0/276787131 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:22.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.070+0000 7f8cd6d9d700 1 -- 172.21.15.3:0/276787131 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cd81488d0 msgr2=0x7f8cd81e2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.070+0000 7f8cd6d9d700 1 --2- 172.21.15.3:0/276787131 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cd81488d0 0x7f8cd81e2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.070+0000 7f8cd6d9d700 1 -- 172.21.15.3:0/276787131 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cd814e670 msgr2=0x7f8cd806e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.070+0000 7f8cd6d9d700 1 --2- 172.21.15.3:0/276787131 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cd814e670 0x7f8cd806e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.070+0000 7f8cd6d9d700 1 -- 172.21.15.3:0/276787131 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc8009550 con 0x7f8cd80b69e0 2023-03-06T14:16:22.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.070+0000 7f8cd759e700 1 --2- 172.21.15.3:0/276787131 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cd814e670 0x7f8cd806e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:16:22.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.071+0000 7f8cd6d9d700 1 --2- 172.21.15.3:0/276787131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cd80b69e0 0x7f8cd81f2290 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8016000 tx=0x7f8cc8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.071+0000 7f8cc77fe700 1 -- 172.21.15.3:0/276787131 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8004450 con 0x7f8cd80b69e0 2023-03-06T14:16:22.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.071+0000 7f8cc77fe700 1 -- 172.21.15.3:0/276787131 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc80045b0 con 0x7f8cd80b69e0 2023-03-06T14:16:22.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.071+0000 7f8cc77fe700 1 -- 172.21.15.3:0/276787131 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc80038e0 con 0x7f8cd80b69e0 2023-03-06T14:16:22.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.071+0000 7f8cdd22c700 1 -- 172.21.15.3:0/276787131 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd814bf00 con 0x7f8cd80b69e0 2023-03-06T14:16:22.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.072+0000 7f8cdd22c700 1 -- 172.21.15.3:0/276787131 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd814bc20 con 0x7f8cd80b69e0 2023-03-06T14:16:22.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.076+0000 7f8cc77fe700 1 -- 172.21.15.3:0/276787131 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8cc800f050 con 0x7f8cd80b69e0 2023-03-06T14:16:22.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.077+0000 7f8cc77fe700 1 --2- 172.21.15.3:0/276787131 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f8cc0068550 0x7f8cc006aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.077+0000 7f8cc77fe700 1 -- 172.21.15.3:0/276787131 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8cc8086fc0 con 0x7f8cd80b69e0 2023-03-06T14:16:22.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.077+0000 7f8cdd22c700 1 -- 172.21.15.3:0/276787131 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cbc0052e0 con 0x7f8cd80b69e0 2023-03-06T14:16:22.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.077+0000 7f8cd659c700 1 --2- 172.21.15.3:0/276787131 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f8cc0068550 0x7f8cc006aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.079+0000 7f8cd659c700 1 --2- 172.21.15.3:0/276787131 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f8cc0068550 0x7f8cc006aa00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8cd814b620 tx=0x7f8ccc00d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.083+0000 7f8cc77fe700 1 -- 172.21.15.3:0/276787131 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8cc80534c0 con 0x7f8cd80b69e0 2023-03-06T14:16:22.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.110+0000 7efcb5e79700 1 Processor -- start 2023-03-06T14:16:22.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.111+0000 7efcb5e79700 1 -- start start 2023-03-06T14:16:22.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.112+0000 7efcb5e79700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7efcb00704b0 0x7efcb01486f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.112+0000 7efcb5e79700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7efcb00b5eb0 0x7efcb00b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.112+0000 7efcb5e79700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb00bd330 con 0x7efcb00b6f20 2023-03-06T14:16:22.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.112+0000 7efcb5e79700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb00b7610 con 0x7efcb00704b0 2023-03-06T14:16:22.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.112+0000 7efcb5e79700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb0070880 con 0x7efcb00b5eb0 2023-03-06T14:16:22.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.112+0000 7efcaf7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7efcb00704b0 0x7efcb01486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.112+0000 7efcaf7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7efcb00704b0 0x7efcb01486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56338/0 (socket says 172.21.15.3:56338) 2023-03-06T14:16:22.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.112+0000 7efcaf7fe700 1 -- 172.21.15.3:0/560977144 learned_addr learned my addr 172.21.15.3:0/560977144 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:22.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.113+0000 7efcaeffd700 1 --2- 172.21.15.3:0/560977144 >> v2:172.21.15.136:3300/0 conn(0x7efcb00b5eb0 0x7efcb00b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.114+0000 7fa515f2b700 1 Processor -- start 2023-03-06T14:16:22.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.115+0000 7fa515f2b700 1 -- start start 2023-03-06T14:16:22.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.116+0000 7fa515f2b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa5101488d0 0x7fa5100b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.116+0000 7fa515f2b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5100b69e0 0x7fa5100b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.116+0000 7fa515f2b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5100bd330 con 0x7fa51014e670 2023-03-06T14:16:22.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.116+0000 7fa515f2b700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5100b7610 con 0x7fa5101488d0 2023-03-06T14:16:22.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.116+0000 7fa515f2b700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5100bbef0 con 0x7fa5100b69e0 2023-03-06T14:16:22.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.117+0000 7fa50effd700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5100b69e0 0x7fa5100b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.117+0000 7fa50f7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa5101488d0 0x7fa5100b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.117+0000 7fa50f7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa5101488d0 0x7fa5100b5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56344/0 (socket says 172.21.15.3:56344) 2023-03-06T14:16:22.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.117+0000 7fa50f7fe700 1 -- 172.21.15.3:0/3541603607 learned_addr learned my addr 172.21.15.3:0/3541603607 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:22.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.118+0000 7fa50f7fe700 1 -- 172.21.15.3:0/3541603607 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5100b69e0 msgr2=0x7fa5100b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:22.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.118+0000 7fa50f7fe700 1 --2- 172.21.15.3:0/3541603607 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5100b69e0 0x7fa5100b6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.118+0000 7fa50f7fe700 1 -- 172.21.15.3:0/3541603607 >> v1:172.21.15.3:6789/0 conn(0x7fa51014e670 legacy=0x7fa51014ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:22.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.118+0000 7fa50f7fe700 1 -- 172.21.15.3:0/3541603607 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5100bd580 con 0x7fa5101488d0 2023-03-06T14:16:22.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.118+0000 7fa50f7fe700 1 --2- 172.21.15.3:0/3541603607 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5101488d0 0x7fa5100b5eb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa5000092e0 tx=0x7fa5000095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6871f885031f98d3 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.113+0000 7efcaf7fe700 1 -- 172.21.15.3:0/560977144 >> v2:172.21.15.136:3300/0 conn(0x7efcb00b5eb0 msgr2=0x7efcb00b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:22.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.113+0000 7efcaf7fe700 1 --2- 172.21.15.3:0/560977144 >> v2:172.21.15.136:3300/0 conn(0x7efcb00b5eb0 0x7efcb00b69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.113+0000 7efcaf7fe700 1 -- 172.21.15.3:0/560977144 >> v1:172.21.15.3:6789/0 conn(0x7efcb00b6f20 legacy=0x7efcb014e670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-06T14:16:22.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.113+0000 7efcaf7fe700 1 -- 172.21.15.3:0/560977144 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb00bd580 con 0x7efcb00704b0 2023-03-06T14:16:22.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.113+0000 7efcaf7fe700 1 --2- 172.21.15.3:0/560977144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcb00704b0 0x7efcb01486f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efcb006ff60 tx=0x7efca0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfccaf4c2ee1a38b server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.114+0000 7efcae7fc700 1 -- 172.21.15.3:0/560977144 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0004230 con 0x7efcb00704b0 2023-03-06T14:16:22.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.114+0000 7efcae7fc700 1 -- 172.21.15.3:0/560977144 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca0004390 con 0x7efcb00704b0 2023-03-06T14:16:22.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.114+0000 7efcae7fc700 1 -- 172.21.15.3:0/560977144 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca00036a0 con 0x7efcb00704b0 2023-03-06T14:16:22.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.115+0000 7efcb5e79700 1 -- 172.21.15.3:0/560977144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcb00704b0 msgr2=0x7efcb01486f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.115+0000 7efcb5e79700 1 --2- 172.21.15.3:0/560977144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcb00704b0 0x7efcb01486f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efcb006ff60 tx=0x7efca0009bd0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.115+0000 7efcb5e79700 1 -- 172.21.15.3:0/560977144 shutdown_connections 2023-03-06T14:16:22.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.115+0000 7efcb5e79700 1 --2- 172.21.15.3:0/560977144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcb00704b0 0x7efcb01486f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.115+0000 7efcb5e79700 1 --2- 172.21.15.3:0/560977144 >> v2:172.21.15.136:3300/0 conn(0x7efcb00b5eb0 0x7efcb00b69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.115+0000 7efcb5e79700 1 -- 172.21.15.3:0/560977144 >> 172.21.15.3:0/560977144 conn(0x7efcb00c1b40 msgr2=0x7efcb006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:22.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.115+0000 7efcb5e79700 1 -- 172.21.15.3:0/560977144 shutdown_connections 2023-03-06T14:16:22.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.115+0000 7efcb5e79700 1 -- 172.21.15.3:0/560977144 wait complete. 2023-03-06T14:16:22.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.117+0000 7efcb5e79700 1 Processor -- start 2023-03-06T14:16:22.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.117+0000 7efcb5e79700 1 -- start start 2023-03-06T14:16:22.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.118+0000 7efcb5e79700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcb00704b0 0x7efcb00b84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.118+0000 7efcb5e79700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efcb00b5eb0 0x7efcb014ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.118+0000 7efcb5e79700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcb00b6f20 0x7efcb006c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.118+0000 7efcb5e79700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb006e250 con 0x7efcb00b6f20 2023-03-06T14:16:22.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.118+0000 7efcb5e79700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb00b8a10 con 0x7efcb00704b0 2023-03-06T14:16:22.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.118+0000 7efcb5e79700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb0142f70 con 0x7efcb00b5eb0 2023-03-06T14:16:22.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.119+0000 7efcaeffd700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efcb00b5eb0 0x7efcb014ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.119+0000 7efcaeffd700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efcb00b5eb0 0x7efcb014ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.3:49328/0 (socket says 172.21.15.3:49328) 2023-03-06T14:16:22.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.119+0000 7efcaeffd700 1 -- 172.21.15.3:0/268347214 learned_addr learned my addr 172.21.15.3:0/268347214 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:22.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.119+0000 7efcaf7fe700 1 --2- 172.21.15.3:0/268347214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcb00704b0 0x7efcb00b84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.119+0000 7efcaeffd700 1 -- 172.21.15.3:0/268347214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcb00704b0 msgr2=0x7efcb00b84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.119+0000 7efcaeffd700 1 --2- 172.21.15.3:0/268347214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcb00704b0 0x7efcb00b84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.119+0000 7efcaeffd700 1 -- 172.21.15.3:0/268347214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcb00b6f20 msgr2=0x7efcb006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.119+0000 7efcaeffd700 1 --2- 172.21.15.3:0/268347214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcb00b6f20 0x7efcb006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.119+0000 7efcaeffd700 1 -- 172.21.15.3:0/268347214 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca0009550 con 0x7efcb00b5eb0 2023-03-06T14:16:22.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.119+0000 7fa50e7fc700 1 -- 172.21.15.3:0/3541603607 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500004230 con 0x7fa5101488d0 2023-03-06T14:16:22.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.119+0000 7fa50e7fc700 1 -- 172.21.15.3:0/3541603607 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa500004390 con 0x7fa5101488d0 2023-03-06T14:16:22.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.119+0000 7fa50e7fc700 1 -- 172.21.15.3:0/3541603607 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50000c770 con 0x7fa5101488d0 2023-03-06T14:16:22.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.120+0000 7fa515f2b700 1 -- 172.21.15.3:0/3541603607 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5101488d0 msgr2=0x7fa5100b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.120+0000 7fa515f2b700 1 --2- 172.21.15.3:0/3541603607 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5101488d0 0x7fa5100b5eb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa5000092e0 tx=0x7fa5000095f0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.121+0000 7fa515f2b700 1 -- 172.21.15.3:0/3541603607 shutdown_connections 2023-03-06T14:16:22.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.121+0000 7fa515f2b700 1 --2- 172.21.15.3:0/3541603607 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5101488d0 0x7fa5100b5eb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.121+0000 7fa515f2b700 1 --2- 172.21.15.3:0/3541603607 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5100b69e0 0x7fa5100b6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.122+0000 7fa515f2b700 1 -- 172.21.15.3:0/3541603607 >> 172.21.15.3:0/3541603607 conn(0x7fa5100c1b40 msgr2=0x7fa51006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:22.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.122+0000 7fa515f2b700 1 -- 172.21.15.3:0/3541603607 shutdown_connections 2023-03-06T14:16:22.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.122+0000 7fa515f2b700 1 -- 172.21.15.3:0/3541603607 wait complete. 2023-03-06T14:16:22.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.124+0000 7fa515f2b700 1 Processor -- start 2023-03-06T14:16:22.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.124+0000 7fa515f2b700 1 -- start start 2023-03-06T14:16:22.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.125+0000 7fa515f2b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5100b69e0 0x7fa51013e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.125+0000 7fa515f2b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5101488d0 0x7fa5101f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.125+0000 7fa515f2b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa51014e670 0x7fa51013ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.125+0000 7fa515f2b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5101ebd90 con 0x7fa51014e670 2023-03-06T14:16:22.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.125+0000 7fa515f2b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa510142350 con 0x7fa5100b69e0 2023-03-06T14:16:22.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.125+0000 7fa515f2b700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5101f5a40 con 0x7fa5101488d0 2023-03-06T14:16:22.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.125+0000 7fa50ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa51014e670 0x7fa51013ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.125+0000 7fa50ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa51014e670 0x7fa51013ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56358/0 (socket says 172.21.15.3:56358) 2023-03-06T14:16:22.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.125+0000 7fa50ffff700 1 -- 172.21.15.3:0/1825198434 learned_addr learned my addr 172.21.15.3:0/1825198434 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:22.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.126+0000 7fa50f7fe700 1 --2- 172.21.15.3:0/1825198434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5100b69e0 0x7fa51013e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.126+0000 7fa50effd700 1 --2- 172.21.15.3:0/1825198434 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5101488d0 0x7fa5101f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.126+0000 7efcaeffd700 1 --2- 172.21.15.3:0/268347214 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efcb00b5eb0 0x7efcb014ca30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efca8007f20 tx=0x7efca800e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.126+0000 7fa50ffff700 1 -- 172.21.15.3:0/1825198434 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5101488d0 msgr2=0x7fa5101f5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.126+0000 7fa50ffff700 1 --2- 172.21.15.3:0/1825198434 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5101488d0 0x7fa5101f5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.126+0000 7fa50ffff700 1 -- 172.21.15.3:0/1825198434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5100b69e0 msgr2=0x7fa51013e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.126+0000 7fa50ffff700 1 --2- 172.21.15.3:0/1825198434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5100b69e0 0x7fa51013e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.126+0000 7fa50ffff700 1 -- 172.21.15.3:0/1825198434 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa500009de0 con 0x7fa51014e670 2023-03-06T14:16:22.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.126+0000 7fa50ffff700 1 --2- 172.21.15.3:0/1825198434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa51014e670 0x7fa51013ab50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa50400b3e0 tx=0x7fa50400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.127+0000 7fa4fffff700 1 -- 172.21.15.3:0/1825198434 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400bea0 con 0x7fa51014e670 2023-03-06T14:16:22.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.127+0000 7fa4fffff700 1 -- 172.21.15.3:0/1825198434 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa504011850 con 0x7fa51014e670 2023-03-06T14:16:22.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.127+0000 7fa4fffff700 1 -- 172.21.15.3:0/1825198434 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa504011c00 con 0x7fa51014e670 2023-03-06T14:16:22.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.127+0000 7fa515f2b700 1 -- 172.21.15.3:0/1825198434 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51014bf00 con 0x7fa51014e670 2023-03-06T14:16:22.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.127+0000 7fa515f2b700 1 -- 172.21.15.3:0/1825198434 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51014bc20 con 0x7fa51014e670 2023-03-06T14:16:22.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.130+0000 7efc97fff700 1 -- 172.21.15.3:0/268347214 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca800ee50 con 0x7efcb00b5eb0 2023-03-06T14:16:22.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.130+0000 7efc97fff700 1 -- 172.21.15.3:0/268347214 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca8014420 con 0x7efcb00b5eb0 2023-03-06T14:16:22.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.130+0000 7efc97fff700 1 -- 172.21.15.3:0/268347214 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca80147d0 con 0x7efcb00b5eb0 2023-03-06T14:16:22.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.131+0000 7efcb5e79700 1 -- 172.21.15.3:0/268347214 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb014bf00 con 0x7efcb00b5eb0 2023-03-06T14:16:22.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.131+0000 7efcb5e79700 1 -- 172.21.15.3:0/268347214 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb014bc20 con 0x7efcb00b5eb0 2023-03-06T14:16:22.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.131+0000 7fa4fffff700 1 -- 172.21.15.3:0/1825198434 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa504021070 con 0x7fa51014e670 2023-03-06T14:16:22.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.131+0000 7fa4fffff700 1 --2- 172.21.15.3:0/1825198434 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa4f4068390 0x7fa4f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.131+0000 7fa4fffff700 1 -- 172.21.15.3:0/1825198434 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa504085df0 con 0x7fa51014e670 2023-03-06T14:16:22.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.132+0000 7efcb5e79700 1 -- 172.21.15.3:0/268347214 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb01529b0 con 0x7efcb00b5eb0 2023-03-06T14:16:22.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.132+0000 7fa50f7fe700 1 --2- 172.21.15.3:0/1825198434 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa4f4068390 0x7fa4f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.132+0000 7fa515f2b700 1 -- 172.21.15.3:0/1825198434 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ec0052e0 con 0x7fa51014e670 2023-03-06T14:16:22.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.133+0000 7efc97fff700 1 -- 172.21.15.3:0/268347214 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7efca8012050 con 0x7efcb00b5eb0 2023-03-06T14:16:22.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.134+0000 7efc97fff700 1 --2- 172.21.15.3:0/268347214 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7efc9c0683c0 0x7efc9c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.134+0000 7efc97fff700 1 -- 172.21.15.3:0/268347214 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efca80869c0 con 0x7efcb00b5eb0 2023-03-06T14:16:22.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.134+0000 7efcaf7fe700 1 --2- 172.21.15.3:0/268347214 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7efc9c0683c0 0x7efc9c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.137+0000 7fa50f7fe700 1 --2- 172.21.15.3:0/1825198434 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa4f4068390 0x7fa4f406a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa500009630 tx=0x7fa500008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.138+0000 7efcaf7fe700 1 --2- 172.21.15.3:0/268347214 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7efc9c0683c0 0x7efc9c06a870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efca0000c00 tx=0x7efca0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.139+0000 7fa4fffff700 1 -- 172.21.15.3:0/1825198434 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa5040522f0 con 0x7fa51014e670 2023-03-06T14:16:22.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.139+0000 7efc97fff700 1 -- 172.21.15.3:0/268347214 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7efca80568f0 con 0x7efcb00b5eb0 2023-03-06T14:16:22.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.175+0000 7f0a12fca700 1 Processor -- start 2023-03-06T14:16:22.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.175+0000 7f0a12fca700 1 -- start start 2023-03-06T14:16:22.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.177+0000 7f0a12fca700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0a0c149d00 0x7f0a0c06b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.177+0000 7f0a12fca700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0c154190 con 0x7f0a0c070cc0 2023-03-06T14:16:22.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.177+0000 7f0a12fca700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0c072450 con 0x7f0a0c06b820 2023-03-06T14:16:22.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.177+0000 7f0a12fca700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0c0b6100 con 0x7f0a0c149d00 2023-03-06T14:16:22.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.178+0000 7f0a0bfff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f0a0c06b820 0x7f0a0c0705b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.3:56126/0 (socket says 172.21.15.3:56126) 2023-03-06T14:16:22.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.178+0000 7f0a0bfff700 1 -- 172.21.15.3:0/1220288224 learned_addr learned my addr 172.21.15.3:0/1220288224 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:22.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.178+0000 7f0a0b7fe700 1 -- 172.21.15.3:0/1220288224 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723654645 0 0) 0x7f0a0c072450 con 0x7f0a0c06b820 2023-03-06T14:16:22.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.178+0000 7f0a0b7fe700 1 -- 172.21.15.3:0/1220288224 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09fc0035b0 con 0x7f0a0c06b820 2023-03-06T14:16:22.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.178+0000 7f0a0b7fe700 1 -- 172.21.15.3:0/1220288224 <== mon.1 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2383220721 0 0) 0x7f09fc0035b0 con 0x7f0a0c06b820 2023-03-06T14:16:22.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.178+0000 7f0a0b7fe700 1 -- 172.21.15.3:0/1220288224 >> v2:172.21.15.136:3300/0 conn(0x7f0a0c149d00 msgr2=0x7f0a0c06b2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-06T14:16:22.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.178+0000 7f0a0b7fe700 1 --2- 172.21.15.3:0/1220288224 >> v2:172.21.15.136:3300/0 conn(0x7f0a0c149d00 0x7f0a0c06b2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.178+0000 7f0a0b7fe700 1 -- 172.21.15.3:0/1220288224 >> v1:172.21.15.3:6789/0 conn(0x7f0a0c070cc0 legacy=0x7f0a0c0bc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:22.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.178+0000 7f0a0b7fe700 1 -- 172.21.15.3:0/1220288224 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c071a20 con 0x7f0a0c06b820 2023-03-06T14:16:22.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.178+0000 7f0a0b7fe700 1 -- 172.21.15.3:0/1220288224 <== mon.1 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3255535284 0 0) 0x7f09f8001670 con 0x7f0a0c06b820 2023-03-06T14:16:22.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.178+0000 7f0a0b7fe700 1 -- 172.21.15.3:0/1220288224 >> v1:172.21.15.136:6789/0 conn(0x7f0a0c06b820 legacy=0x7f0a0c0705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.178+0000 7f0a0b7fe700 1 --2- 172.21.15.3:0/1220288224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09fc003a00 0x7f09fc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.178+0000 7f0a0b7fe700 1 --2- 172.21.15.3:0/1220288224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09fc004850 0x7f09fc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.178+0000 7f0a0b7fe700 1 --2- 172.21.15.3:0/1220288224 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f09fc005300 0x7f09fc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.178+0000 7f0a0b7fe700 1 -- 172.21.15.3:0/1220288224 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0b6100 con 0x7f09fc003a00 2023-03-06T14:16:22.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.179+0000 7f0a0b7fe700 1 -- 172.21.15.3:0/1220288224 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc01d240 con 0x7f09fc004850 2023-03-06T14:16:22.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.179+0000 7f0a0b7fe700 1 -- 172.21.15.3:0/1220288224 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc01d400 con 0x7f09fc005300 2023-03-06T14:16:22.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.179+0000 7f0a11567700 1 --2- 172.21.15.3:0/1220288224 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f09fc005300 0x7f09fc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.179+0000 7f0a0bfff700 1 --2- 172.21.15.3:0/1220288224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09fc004850 0x7f09fc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.179+0000 7f0a11567700 1 -- 172.21.15.3:0/1220288224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09fc004850 msgr2=0x7f09fc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:22.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.179+0000 7f0a11567700 1 --2- 172.21.15.3:0/1220288224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09fc004850 0x7f09fc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.179+0000 7f0a11567700 1 -- 172.21.15.3:0/1220288224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09fc003a00 msgr2=0x7f09fc003df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-06T14:16:22.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.179+0000 7f0a11567700 1 --2- 172.21.15.3:0/1220288224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09fc003a00 0x7f09fc003df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.179+0000 7f0a11567700 1 -- 172.21.15.3:0/1220288224 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c071a20 con 0x7f09fc005300 2023-03-06T14:16:22.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.179+0000 7f0a11567700 1 -- 172.21.15.3:0/1220288224 reap_dead start 2023-03-06T14:16:22.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.179+0000 7f0a11567700 1 --2- 172.21.15.3:0/1220288224 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f09fc005300 0x7f09fc00ba10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0a04001990 tx=0x7f09fc005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f8eb1b644317cee server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.180+0000 7f0a0b7fe700 1 -- 172.21.15.3:0/1220288224 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04003a20 con 0x7f09fc005300 2023-03-06T14:16:22.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.180+0000 7f0a0b7fe700 1 -- 172.21.15.3:0/1220288224 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a04003b80 con 0x7f09fc005300 2023-03-06T14:16:22.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.180+0000 7f0a0b7fe700 1 -- 172.21.15.3:0/1220288224 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a040050d0 con 0x7f09fc005300 2023-03-06T14:16:22.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f0a12fca700 1 -- 172.21.15.3:0/1220288224 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f09fc005300 msgr2=0x7f09fc00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f0a12fca700 1 --2- 172.21.15.3:0/1220288224 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f09fc005300 0x7f09fc00ba10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0a04001990 tx=0x7f09fc005880 comp rx=0 tx=0).stop 2023-03-06T14:16:22.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f0a12fca700 1 -- 172.21.15.3:0/1220288224 shutdown_connections 2023-03-06T14:16:22.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f0a12fca700 1 --2- 172.21.15.3:0/1220288224 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f09fc005300 0x7f09fc00ba10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f0a12fca700 1 -- 172.21.15.3:0/1220288224 >> 172.21.15.3:0/1220288224 conn(0x7f0a0c0c0eb0 msgr2=0x7f0a0c0c12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:22.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f0a12fca700 1 -- 172.21.15.3:0/1220288224 shutdown_connections 2023-03-06T14:16:22.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f0a12fca700 1 -- 172.21.15.3:0/1220288224 wait complete. 2023-03-06T14:16:22.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.179+0000 7f1727fee700 1 Processor -- start 2023-03-06T14:16:22.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.179+0000 7f1727fee700 1 -- start start 2023-03-06T14:16:22.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f1727fee700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f172014a0d0 0x7f17200705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f1727fee700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1720071ed0 0x7f1720070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f1727fee700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1720154190 con 0x7f1720149d00 2023-03-06T14:16:22.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f1727fee700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17200b6100 con 0x7f1720071ed0 2023-03-06T14:16:22.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f1727fee700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1720072450 con 0x7f172014a0d0 2023-03-06T14:16:22.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f1725589700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f172014a0d0 0x7f17200705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f1725589700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f172014a0d0 0x7f17200705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.3:49356/0 (socket says 172.21.15.3:49356) 2023-03-06T14:16:22.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f1725589700 1 -- 172.21.15.3:0/2365268903 learned_addr learned my addr 172.21.15.3:0/2365268903 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:22.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f172658b700 1 --2- 172.21.15.3:0/2365268903 >> v2:172.21.15.136:3300/0 conn(0x7f1720071ed0 0x7f1720070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f1725589700 1 -- 172.21.15.3:0/2365268903 >> v2:172.21.15.136:3300/0 conn(0x7f1720071ed0 msgr2=0x7f1720070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:22.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f1725589700 1 --2- 172.21.15.3:0/2365268903 >> v2:172.21.15.136:3300/0 conn(0x7f1720071ed0 0x7f1720070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f1725589700 1 -- 172.21.15.3:0/2365268903 >> v1:172.21.15.3:6789/0 conn(0x7f1720149d00 legacy=0x7f172006b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:22.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.181+0000 7f1725589700 1 -- 172.21.15.3:0/2365268903 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1720071a20 con 0x7f172014a0d0 2023-03-06T14:16:22.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.182+0000 7f1725589700 1 --2- 172.21.15.3:0/2365268903 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f172014a0d0 0x7f17200705b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1718009e50 tx=0x7f171800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67304af88a54876c server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.182+0000 7f1724d88700 1 -- 172.21.15.3:0/2365268903 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171800e070 con 0x7f172014a0d0 2023-03-06T14:16:22.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.182+0000 7f1724d88700 1 -- 172.21.15.3:0/2365268903 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1718003a20 con 0x7f172014a0d0 2023-03-06T14:16:22.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.182+0000 7f1724d88700 1 -- 172.21.15.3:0/2365268903 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718003db0 con 0x7f172014a0d0 2023-03-06T14:16:22.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.183+0000 7f1727fee700 1 -- 172.21.15.3:0/2365268903 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f172014a0d0 msgr2=0x7f17200705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.183+0000 7f1727fee700 1 --2- 172.21.15.3:0/2365268903 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f172014a0d0 0x7f17200705b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1718009e50 tx=0x7f171800b330 comp rx=0 tx=0).stop 2023-03-06T14:16:22.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.183+0000 7f1727fee700 1 -- 172.21.15.3:0/2365268903 shutdown_connections 2023-03-06T14:16:22.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.183+0000 7f1727fee700 1 --2- 172.21.15.3:0/2365268903 >> v2:172.21.15.136:3300/0 conn(0x7f1720071ed0 0x7f1720070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.183+0000 7f1727fee700 1 --2- 172.21.15.3:0/2365268903 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f172014a0d0 0x7f17200705b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.183+0000 7f1727fee700 1 -- 172.21.15.3:0/2365268903 >> 172.21.15.3:0/2365268903 conn(0x7f17200c0eb0 msgr2=0x7f17200c12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:22.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.183+0000 7f0a12fca700 1 Processor -- start 2023-03-06T14:16:22.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.183+0000 7f1727fee700 1 -- 172.21.15.3:0/2365268903 shutdown_connections 2023-03-06T14:16:22.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.183+0000 7f0a12fca700 1 -- start start 2023-03-06T14:16:22.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.185+0000 7f0a12fca700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09fc005300 0x7f0a0c0b9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.185+0000 7f0a12fca700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a0c0baf70 0x7f0a0c141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.185+0000 7f0a12fca700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a0c13cd30 0x7f0a0c0b8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.185+0000 7f0a12fca700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c06e060 con 0x7f0a0c0baf70 2023-03-06T14:16:22.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.185+0000 7f0a12fca700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0b8290 con 0x7f09fc005300 2023-03-06T14:16:22.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.185+0000 7f0a12fca700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c141bc0 con 0x7f0a0c13cd30 2023-03-06T14:16:22.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.185+0000 7fc8530e8700 1 Processor -- start 2023-03-06T14:16:22.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.185+0000 7f0a0bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a0c0baf70 0x7f0a0c141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.185+0000 7f0a0bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a0c0baf70 0x7f0a0c141680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56380/0 (socket says 172.21.15.3:56380) 2023-03-06T14:16:22.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.185+0000 7f0a0bfff700 1 -- 172.21.15.3:0/2384290237 learned_addr learned my addr 172.21.15.3:0/2384290237 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:22.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.183+0000 7f1727fee700 1 -- 172.21.15.3:0/2365268903 wait complete. 2023-03-06T14:16:22.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.185+0000 7f1727fee700 1 Processor -- start 2023-03-06T14:16:22.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.185+0000 7f1727fee700 1 -- start start 2023-03-06T14:16:22.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.185+0000 7f0a11567700 1 --2- 172.21.15.3:0/2384290237 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a0c13cd30 0x7f0a0c0b8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7f0a0bfff700 1 -- 172.21.15.3:0/2384290237 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a0c13cd30 msgr2=0x7f0a0c0b8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7f0a0bfff700 1 --2- 172.21.15.3:0/2384290237 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a0c13cd30 0x7f0a0c0b8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7f0a0bfff700 1 -- 172.21.15.3:0/2384290237 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09fc005300 msgr2=0x7f0a0c0b9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7f0a0bfff700 1 --2- 172.21.15.3:0/2384290237 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09fc005300 0x7f0a0c0b9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7f0a0bfff700 1 -- 172.21.15.3:0/2384290237 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c153860 con 0x7f0a0c0baf70 2023-03-06T14:16:22.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7f0a0bfff700 1 --2- 172.21.15.3:0/2384290237 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a0c0baf70 0x7f0a0c141680 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f09f8007290 tx=0x7f09f8007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7f1727fee700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1720071ed0 0x7f172014fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7f1727fee700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1720149d00 0x7f17200bab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7f1727fee700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f172014a0d0 0x7f172006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7f1727fee700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1720150cc0 con 0x7f1720071ed0 2023-03-06T14:16:22.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7f1727fee700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1720154630 con 0x7f1720149d00 2023-03-06T14:16:22.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7f1727fee700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17200b9dc0 con 0x7f172014a0d0 2023-03-06T14:16:22.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7f172658b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f172014a0d0 0x7f172006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7f172658b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f172014a0d0 0x7f172006d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.3:49366/0 (socket says 172.21.15.3:49366) 2023-03-06T14:16:22.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7f172658b700 1 -- 172.21.15.3:0/467183460 learned_addr learned my addr 172.21.15.3:0/467183460 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:22.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.185+0000 7fc8530e8700 1 -- start start 2023-03-06T14:16:22.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7fc8530e8700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc84c0b77d0 0x7fc84c0b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7fc8530e8700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc84c0a2ec0 0x7fc84c156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7fc8530e8700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84c153e90 con 0x7fc84c0b80e0 2023-03-06T14:16:22.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7fc8530e8700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84c0bdc90 con 0x7fc84c0a2ec0 2023-03-06T14:16:22.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.186+0000 7fc8530e8700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c1543c0 con 0x7fc84c0b77d0 2023-03-06T14:16:22.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.187+0000 7fc850e84700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc84c0b77d0 0x7fc84c0b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.187+0000 7fc850e84700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc84c0b77d0 0x7fc84c0b7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.3:49368/0 (socket says 172.21.15.3:49368) 2023-03-06T14:16:22.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.187+0000 7fc850e84700 1 -- 172.21.15.3:0/2881494129 learned_addr learned my addr 172.21.15.3:0/2881494129 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:22.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.187+0000 7f1725d8a700 1 --2- 172.21.15.3:0/467183460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1720071ed0 0x7f172014fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.187+0000 7f172658b700 1 -- 172.21.15.3:0/467183460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1720149d00 msgr2=0x7f17200bab80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-06T14:16:22.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.187+0000 7f172658b700 1 --2- 172.21.15.3:0/467183460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1720149d00 0x7f17200bab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.187+0000 7fc851685700 1 --2- 172.21.15.3:0/2881494129 >> v2:172.21.15.136:3300/0 conn(0x7fc84c0a2ec0 0x7fc84c156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.187+0000 7f172658b700 1 -- 172.21.15.3:0/467183460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1720071ed0 msgr2=0x7f172014fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.187+0000 7f172658b700 1 --2- 172.21.15.3:0/467183460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1720071ed0 0x7f172014fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.187+0000 7f172658b700 1 -- 172.21.15.3:0/467183460 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1718009b30 con 0x7f172014a0d0 2023-03-06T14:16:22.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.187+0000 7f1725d8a700 1 --2- 172.21.15.3:0/467183460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1720071ed0 0x7f172014fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:16:22.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.187+0000 7f172658b700 1 --2- 172.21.15.3:0/467183460 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f172014a0d0 0x7f172006d7f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f171c00e950 tx=0x7f171c00ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.187+0000 7fc851685700 1 -- 172.21.15.3:0/2881494129 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc84c0b77d0 msgr2=0x7fc84c0b7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:22.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.187+0000 7fc851685700 1 --2- 172.21.15.3:0/2881494129 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc84c0b77d0 0x7fc84c0b7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.187+0000 7fc851685700 1 -- 172.21.15.3:0/2881494129 >> v1:172.21.15.136:6789/0 conn(0x7fc84c0b80e0 legacy=0x7fc84c14d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.187+0000 7fc851685700 1 -- 172.21.15.3:0/2881494129 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84c06f110 con 0x7fc84c0a2ec0 2023-03-06T14:16:22.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.187+0000 7fc851685700 1 --2- 172.21.15.3:0/2881494129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc84c0a2ec0 0x7fc84c156ce0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc844009d90 tx=0x7fc84400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8791b2473e5a3420 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.196+0000 7f0a097fa700 1 -- 172.21.15.3:0/2384290237 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f800f7d0 con 0x7f0a0c0baf70 2023-03-06T14:16:22.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.196+0000 7f0a097fa700 1 -- 172.21.15.3:0/2384290237 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f800f950 con 0x7f0a0c0baf70 2023-03-06T14:16:22.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.196+0000 7f0a12fca700 1 -- 172.21.15.3:0/2384290237 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0c153580 con 0x7f0a0c0baf70 2023-03-06T14:16:22.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.196+0000 7f0a12fca700 1 -- 172.21.15.3:0/2384290237 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0c153b40 con 0x7f0a0c0baf70 2023-03-06T14:16:22.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.196+0000 7f17167fc700 1 -- 172.21.15.3:0/467183460 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c009730 con 0x7f172014a0d0 2023-03-06T14:16:22.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.196+0000 7f17167fc700 1 -- 172.21.15.3:0/467183460 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c00c850 con 0x7f172014a0d0 2023-03-06T14:16:22.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.196+0000 7f17167fc700 1 -- 172.21.15.3:0/467183460 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c00cbe0 con 0x7f172014a0d0 2023-03-06T14:16:22.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.197+0000 7f0a097fa700 1 -- 172.21.15.3:0/2384290237 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f800fd00 con 0x7f0a0c0baf70 2023-03-06T14:16:22.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.197+0000 7fc84b7fe700 1 -- 172.21.15.3:0/2881494129 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84400e070 con 0x7fc84c0a2ec0 2023-03-06T14:16:22.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.197+0000 7fc84b7fe700 1 -- 172.21.15.3:0/2881494129 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc844003a20 con 0x7fc84c0a2ec0 2023-03-06T14:16:22.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.197+0000 7fc84b7fe700 1 -- 172.21.15.3:0/2881494129 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc844003dd0 con 0x7fc84c0a2ec0 2023-03-06T14:16:22.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.198+0000 7fc8530e8700 1 -- 172.21.15.3:0/2881494129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc84c0a2ec0 msgr2=0x7fc84c156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.198+0000 7fc8530e8700 1 --2- 172.21.15.3:0/2881494129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc84c0a2ec0 0x7fc84c156ce0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc844009d90 tx=0x7fc84400b330 comp rx=0 tx=0).stop 2023-03-06T14:16:22.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.199+0000 7fc8530e8700 1 -- 172.21.15.3:0/2881494129 shutdown_connections 2023-03-06T14:16:22.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.199+0000 7fc8530e8700 1 --2- 172.21.15.3:0/2881494129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc84c0a2ec0 0x7fc84c156ce0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.199+0000 7fc8530e8700 1 --2- 172.21.15.3:0/2881494129 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc84c0b77d0 0x7fc84c0b7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.199+0000 7fc8530e8700 1 -- 172.21.15.3:0/2881494129 >> 172.21.15.3:0/2881494129 conn(0x7fc84c0c17d0 msgr2=0x7fc84c0c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:22.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.198+0000 7f0a097fa700 1 -- 172.21.15.3:0/2384290237 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f09f801c030 con 0x7f0a0c0baf70 2023-03-06T14:16:22.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.199+0000 7f0a097fa700 1 --2- 172.21.15.3:0/2384290237 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f09f0068340 0x7f09f006a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.199+0000 7f0a10d66700 1 --2- 172.21.15.3:0/2384290237 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f09f0068340 0x7f09f006a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.198+0000 7f1727fee700 1 -- 172.21.15.3:0/467183460 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1720153860 con 0x7f172014a0d0 2023-03-06T14:16:22.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.198+0000 7f1727fee700 1 -- 172.21.15.3:0/467183460 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1720153580 con 0x7f172014a0d0 2023-03-06T14:16:22.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.199+0000 7f0a097fa700 1 -- 172.21.15.3:0/2384290237 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f09f800fe60 con 0x7f0a0c0baf70 2023-03-06T14:16:22.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.200+0000 7fc8530e8700 1 -- 172.21.15.3:0/2881494129 shutdown_connections 2023-03-06T14:16:22.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.201+0000 7f0a10d66700 1 --2- 172.21.15.3:0/2384290237 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f09f0068340 0x7f09f006a7f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c068ae0 tx=0x7f0a00006cd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.200+0000 7fc8530e8700 1 -- 172.21.15.3:0/2881494129 wait complete. 2023-03-06T14:16:22.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.201+0000 7fc8530e8700 1 Processor -- start 2023-03-06T14:16:22.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.201+0000 7f17167fc700 1 -- 172.21.15.3:0/467183460 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f171c019030 con 0x7f172014a0d0 2023-03-06T14:16:22.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.202+0000 7f17167fc700 1 --2- 172.21.15.3:0/467183460 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f17040683c0 0x7f170406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.202+0000 7f17167fc700 1 -- 172.21.15.3:0/467183460 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f171c085fb0 con 0x7f172014a0d0 2023-03-06T14:16:22.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.202+0000 7f0a12fca700 1 -- 172.21.15.3:0/2384290237 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ec0052e0 con 0x7f0a0c0baf70 2023-03-06T14:16:22.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.203+0000 7f1727fee700 1 -- 172.21.15.3:0/467183460 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1720153b40 con 0x7f172014a0d0 2023-03-06T14:16:22.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.202+0000 7fc8530e8700 1 -- start start 2023-03-06T14:16:22.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.203+0000 7fc8530e8700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc84c0a2ec0 0x7fc84c0a6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.203+0000 7fc8530e8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc84c0b77d0 0x7fc84c06b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.203+0000 7fc8530e8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc84c0b80e0 0x7fc84c131f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.203+0000 7fc8530e8700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c0a6a80 con 0x7fc84c0b77d0 2023-03-06T14:16:22.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.203+0000 7fc8530e8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c06a2d0 con 0x7fc84c0b80e0 2023-03-06T14:16:22.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.203+0000 7fc8530e8700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c1324c0 con 0x7fc84c0a2ec0 2023-03-06T14:16:22.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.203+0000 7fc850e84700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc84c0a2ec0 0x7fc84c0a6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.203+0000 7fc851685700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc84c0b80e0 0x7fc84c131f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.204+0000 7fc851685700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc84c0b80e0 0x7fc84c131f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.3:42502/0 (socket says 172.21.15.3:42502) 2023-03-06T14:16:22.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.204+0000 7fc851685700 1 -- 172.21.15.3:0/504510476 learned_addr learned my addr 172.21.15.3:0/504510476 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:22.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.204+0000 7fc84bfff700 1 --2- 172.21.15.3:0/504510476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc84c0b77d0 0x7fc84c06b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.204+0000 7fc851685700 1 -- 172.21.15.3:0/504510476 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc84c0a2ec0 msgr2=0x7fc84c0a6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.204+0000 7fc851685700 1 --2- 172.21.15.3:0/504510476 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc84c0a2ec0 0x7fc84c0a6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.204+0000 7fc851685700 1 -- 172.21.15.3:0/504510476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc84c0b77d0 msgr2=0x7fc84c06b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.204+0000 7fc851685700 1 --2- 172.21.15.3:0/504510476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc84c0b77d0 0x7fc84c06b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.204+0000 7fc851685700 1 -- 172.21.15.3:0/504510476 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc844009a70 con 0x7fc84c0b80e0 2023-03-06T14:16:22.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.205+0000 7f1725d8a700 1 --2- 172.21.15.3:0/467183460 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f17040683c0 0x7f170406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.205+0000 7fc851685700 1 --2- 172.21.15.3:0/504510476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc84c0b80e0 0x7fc84c131f80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc84400b680 tx=0x7fc844004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.199+0000 7fa33f7e6700 1 Processor -- start 2023-03-06T14:16:22.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.200+0000 7fa33f7e6700 1 -- start start 2023-03-06T14:16:22.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.206+0000 7fc8497fa700 1 -- 172.21.15.3:0/504510476 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc844004620 con 0x7fc84c0b80e0 2023-03-06T14:16:22.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.201+0000 7fa33f7e6700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa33806e8e0 0x7fa3380a5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.201+0000 7fa33f7e6700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa33806ecb0 0x7fa3380704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.201+0000 7fa33f7e6700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3380a5bc0 0x7fa3380709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.201+0000 7fa33f7e6700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3381541b0 con 0x7fa33806e8e0 2023-03-06T14:16:22.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.201+0000 7fa33f7e6700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3380b64c0 con 0x7fa33806ecb0 2023-03-06T14:16:22.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.201+0000 7fa33f7e6700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa338153550 con 0x7fa3380a5bc0 2023-03-06T14:16:22.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.201+0000 7fa33d582700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa33806e8e0 0x7fa3380a5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.201+0000 7fa33d582700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa33806e8e0 0x7fa3380a5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56400/0 (socket says 172.21.15.3:56400) 2023-03-06T14:16:22.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.201+0000 7fa33d582700 1 -- 172.21.15.3:0/3134736156 learned_addr learned my addr 172.21.15.3:0/3134736156 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:22.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.204+0000 7fa33d582700 1 -- 172.21.15.3:0/3134736156 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3380a5bc0 msgr2=0x7fa3380709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:22.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.204+0000 7fa33d582700 1 --2- 172.21.15.3:0/3134736156 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3380a5bc0 0x7fa3380709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.204+0000 7fa33d582700 1 -- 172.21.15.3:0/3134736156 >> v2:172.21.15.136:3300/0 conn(0x7fa33806ecb0 msgr2=0x7fa3380704b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-06T14:16:22.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.204+0000 7fa33d582700 1 --2- 172.21.15.3:0/3134736156 >> v2:172.21.15.136:3300/0 conn(0x7fa33806ecb0 0x7fa3380704b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.204+0000 7fa33d582700 1 -- 172.21.15.3:0/3134736156 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa338153810 con 0x7fa33806e8e0 2023-03-06T14:16:22.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.205+0000 7fa33d582700 1 --2- 172.21.15.3:0/3134736156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa33806e8e0 0x7fa3380a5680 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa33806f8a0 tx=0x7fa334009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1917a9175c5e42af server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.206+0000 7fc8497fa700 1 -- 172.21.15.3:0/504510476 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc844004780 con 0x7fc84c0b80e0 2023-03-06T14:16:22.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.206+0000 7fc8497fa700 1 -- 172.21.15.3:0/504510476 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc844012670 con 0x7fc84c0b80e0 2023-03-06T14:16:22.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.206+0000 7fc8530e8700 1 -- 172.21.15.3:0/504510476 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84c06f3b0 con 0x7fc84c0b80e0 2023-03-06T14:16:22.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.206+0000 7fc8530e8700 1 -- 172.21.15.3:0/504510476 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84c1540e0 con 0x7fc84c0b80e0 2023-03-06T14:16:22.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.207+0000 7fc8530e8700 1 -- 172.21.15.3:0/504510476 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84c06f690 con 0x7fc84c0b80e0 2023-03-06T14:16:22.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.208+0000 7fc8497fa700 1 -- 172.21.15.3:0/504510476 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc8440127d0 con 0x7fc84c0b80e0 2023-03-06T14:16:22.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.208+0000 7fc8497fa700 1 --2- 172.21.15.3:0/504510476 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc830068320 0x7fc83006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.208+0000 7fc8497fa700 1 -- 172.21.15.3:0/504510476 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc8440880f0 con 0x7fc84c0b80e0 2023-03-06T14:16:22.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.209+0000 7fc850e84700 1 --2- 172.21.15.3:0/504510476 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc830068320 0x7fc83006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.209+0000 7fc850e84700 1 --2- 172.21.15.3:0/504510476 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc830068320 0x7fc83006a7d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc840009ae0 tx=0x7fc840008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.209+0000 7fdba139a700 1 Processor -- start 2023-03-06T14:16:22.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.209+0000 7fdba139a700 1 -- start start 2023-03-06T14:16:22.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.208+0000 7f17167fc700 1 -- 172.21.15.3:0/467183460 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f171c017080 con 0x7f172014a0d0 2023-03-06T14:16:22.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.208+0000 7f1725d8a700 1 --2- 172.21.15.3:0/467183460 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f17040683c0 0x7f170406a870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1710001750 tx=0x7f1710009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.210+0000 7fdba139a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdb9c0bda10 0x7fdb9c14f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.210+0000 7fdba139a700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9c072a30 con 0x7fdb9c0bdde0 2023-03-06T14:16:22.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.210+0000 7fdba139a700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9c06f0f0 con 0x7fdb9c14f670 2023-03-06T14:16:22.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.210+0000 7fdba139a700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb9c06e9b0 con 0x7fdb9c0bda10 2023-03-06T14:16:22.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.210+0000 7fdb9affd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdb9c0bda10 0x7fdb9c14f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.210+0000 7fdb9affd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdb9c0bda10 0x7fdb9c14f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.3:42508/0 (socket says 172.21.15.3:42508) 2023-03-06T14:16:22.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.210+0000 7fdb9affd700 1 -- 172.21.15.3:0/4017340550 learned_addr learned my addr 172.21.15.3:0/4017340550 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:22.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.211+0000 7fdb9affd700 1 -- 172.21.15.3:0/4017340550 >> v1:172.21.15.136:6789/0 conn(0x7fdb9c14f670 legacy=0x7fdb9c155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:22.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.211+0000 7fdb9affd700 1 -- 172.21.15.3:0/4017340550 >> v1:172.21.15.3:6789/0 conn(0x7fdb9c0bdde0 legacy=0x7fdb9c145420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:22.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.211+0000 7fdb9affd700 1 -- 172.21.15.3:0/4017340550 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c06f390 con 0x7fdb9c0bda10 2023-03-06T14:16:22.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.211+0000 7fdb9affd700 1 --2- 172.21.15.3:0/4017340550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb9c0bda10 0x7fdb9c14f130 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400d150 tx=0x7fdb9400d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0c5eeb1c25f8c81 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.211+0000 7fa32ffff700 1 -- 172.21.15.3:0/3134736156 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33400b870 con 0x7fa33806e8e0 2023-03-06T14:16:22.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.211+0000 7f0a097fa700 1 -- 172.21.15.3:0/2384290237 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f09f801a020 con 0x7f0a0c0baf70 2023-03-06T14:16:22.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.211+0000 7fa32ffff700 1 -- 172.21.15.3:0/3134736156 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33400b9d0 con 0x7fa33806e8e0 2023-03-06T14:16:22.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.211+0000 7fa32ffff700 1 -- 172.21.15.3:0/3134736156 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33400bd40 con 0x7fa33806e8e0 2023-03-06T14:16:22.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.212+0000 7fa33f7e6700 1 -- 172.21.15.3:0/3134736156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa33806e8e0 msgr2=0x7fa3380a5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.212+0000 7fa33f7e6700 1 --2- 172.21.15.3:0/3134736156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa33806e8e0 0x7fa3380a5680 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa33806f8a0 tx=0x7fa334009bd0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.213+0000 7fa33f7e6700 1 -- 172.21.15.3:0/3134736156 shutdown_connections 2023-03-06T14:16:22.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.213+0000 7fa33f7e6700 1 --2- 172.21.15.3:0/3134736156 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3380a5bc0 0x7fa3380709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.213+0000 7fa33f7e6700 1 --2- 172.21.15.3:0/3134736156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa33806e8e0 0x7fa3380a5680 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.213+0000 7fa33f7e6700 1 --2- 172.21.15.3:0/3134736156 >> v2:172.21.15.136:3300/0 conn(0x7fa33806ecb0 0x7fa3380704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.213+0000 7fa33f7e6700 1 -- 172.21.15.3:0/3134736156 >> 172.21.15.3:0/3134736156 conn(0x7fa3380c1b40 msgr2=0x7fa33806a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:22.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.213+0000 7fa33f7e6700 1 -- 172.21.15.3:0/3134736156 shutdown_connections 2023-03-06T14:16:22.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.213+0000 7fa33f7e6700 1 -- 172.21.15.3:0/3134736156 wait complete. 2023-03-06T14:16:22.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.214+0000 7fc8497fa700 1 -- 172.21.15.3:0/504510476 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc844054600 con 0x7fc84c0b80e0 2023-03-06T14:16:22.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.215+0000 7fa33f7e6700 1 Processor -- start 2023-03-06T14:16:22.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.215+0000 7fa33f7e6700 1 -- start start 2023-03-06T14:16:22.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.216+0000 7fa33f7e6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa33806e8e0 0x7fa3381594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.216+0000 7fa33f7e6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3380a5bc0 0x7fa338156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.216+0000 7fa33f7e6700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa338157020 0x7fa33815cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.216+0000 7fa33f7e6700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33813fd20 con 0x7fa33806e8e0 2023-03-06T14:16:22.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.216+0000 7fa33f7e6700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa338140210 con 0x7fa3380a5bc0 2023-03-06T14:16:22.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.216+0000 7fa33f7e6700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa338158060 con 0x7fa338157020 2023-03-06T14:16:22.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.216+0000 7fa33d582700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa33806e8e0 0x7fa3381594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.216+0000 7fa33d582700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa33806e8e0 0x7fa3381594b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56426/0 (socket says 172.21.15.3:56426) 2023-03-06T14:16:22.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.216+0000 7fa33d582700 1 -- 172.21.15.3:0/1373507557 learned_addr learned my addr 172.21.15.3:0/1373507557 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:22.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.217+0000 7fa33dd83700 1 --2- 172.21.15.3:0/1373507557 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa338157020 0x7fa33815cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.217+0000 7fa33d582700 1 -- 172.21.15.3:0/1373507557 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa338157020 msgr2=0x7fa33815cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.217+0000 7fa33d582700 1 --2- 172.21.15.3:0/1373507557 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa338157020 0x7fa33815cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.217+0000 7fa33d582700 1 -- 172.21.15.3:0/1373507557 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3380a5bc0 msgr2=0x7fa338156ae0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-06T14:16:22.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.217+0000 7fa33d582700 1 --2- 172.21.15.3:0/1373507557 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3380a5bc0 0x7fa338156ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.217+0000 7fa33d582700 1 -- 172.21.15.3:0/1373507557 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa334009550 con 0x7fa33806e8e0 2023-03-06T14:16:22.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.217+0000 7fa33d582700 1 --2- 172.21.15.3:0/1373507557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa33806e8e0 0x7fa3381594b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa334000c00 tx=0x7fa334004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.220+0000 7fa32dffb700 1 -- 172.21.15.3:0/1373507557 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3340036a0 con 0x7fa33806e8e0 2023-03-06T14:16:22.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.220+0000 7fa32dffb700 1 -- 172.21.15.3:0/1373507557 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa334003800 con 0x7fa33806e8e0 2023-03-06T14:16:22.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.220+0000 7fa32dffb700 1 -- 172.21.15.3:0/1373507557 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa334003bb0 con 0x7fa33806e8e0 2023-03-06T14:16:22.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.220+0000 7fa33f7e6700 1 -- 172.21.15.3:0/1373507557 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa338153dd0 con 0x7fa33806e8e0 2023-03-06T14:16:22.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.220+0000 7fa33f7e6700 1 -- 172.21.15.3:0/1373507557 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa338153af0 con 0x7fa33806e8e0 2023-03-06T14:16:22.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.222+0000 7fa32dffb700 1 -- 172.21.15.3:0/1373507557 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa33400f050 con 0x7fa33806e8e0 2023-03-06T14:16:22.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.223+0000 7fa32dffb700 1 --2- 172.21.15.3:0/1373507557 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa31c068340 0x7fa31c06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.223+0000 7fa32dffb700 1 -- 172.21.15.3:0/1373507557 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa3340878c0 con 0x7fa33806e8e0 2023-03-06T14:16:22.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.225+0000 7fa33cd81700 1 --2- 172.21.15.3:0/1373507557 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa31c068340 0x7fa31c06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.225+0000 7fa33cd81700 1 --2- 172.21.15.3:0/1373507557 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa31c068340 0x7fa31c06a7f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa338139b40 tx=0x7fa328006c60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.226+0000 7fa33f7e6700 1 -- 172.21.15.3:0/1373507557 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3180052e0 con 0x7fa33806e8e0 2023-03-06T14:16:22.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.231+0000 7fdb99ffb700 1 -- 172.21.15.3:0/4017340550 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94010070 con 0x7fdb9c0bda10 2023-03-06T14:16:22.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.231+0000 7fdb99ffb700 1 -- 172.21.15.3:0/4017340550 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9400db30 con 0x7fdb9c0bda10 2023-03-06T14:16:22.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.231+0000 7fdb99ffb700 1 -- 172.21.15.3:0/4017340550 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94003a20 con 0x7fdb9c0bda10 2023-03-06T14:16:22.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.232+0000 7fdba139a700 1 -- 172.21.15.3:0/4017340550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb9c0bda10 msgr2=0x7fdb9c14f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.232+0000 7fdba139a700 1 --2- 172.21.15.3:0/4017340550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb9c0bda10 0x7fdb9c14f130 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400d150 tx=0x7fdb9400d460 comp rx=0 tx=0).stop 2023-03-06T14:16:22.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.235+0000 7fa32dffb700 1 -- 172.21.15.3:0/1373507557 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa334053f10 con 0x7fa33806e8e0 2023-03-06T14:16:22.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.236+0000 7fdba139a700 1 -- 172.21.15.3:0/4017340550 shutdown_connections 2023-03-06T14:16:22.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.236+0000 7fdba139a700 1 --2- 172.21.15.3:0/4017340550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb9c0bda10 0x7fdb9c14f130 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.236+0000 7fdba139a700 1 -- 172.21.15.3:0/4017340550 >> 172.21.15.3:0/4017340550 conn(0x7fdb9c0c17d0 msgr2=0x7fdb9c0c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:22.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.236+0000 7fdba139a700 1 -- 172.21.15.3:0/4017340550 shutdown_connections 2023-03-06T14:16:22.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.236+0000 7fdba139a700 1 -- 172.21.15.3:0/4017340550 wait complete. 2023-03-06T14:16:22.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.238+0000 7fdba139a700 1 Processor -- start 2023-03-06T14:16:22.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.239+0000 7fdba139a700 1 -- start start 2023-03-06T14:16:22.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.240+0000 7fdba139a700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdb9c0bda10 0x7fdb9c0714a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.240+0000 7fdba139a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb9c0bdde0 0x7fdb9c1e8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.240+0000 7fdba139a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb9c14f670 0x7fdb9c1e8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.240+0000 7fdba139a700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c1e2fa0 con 0x7fdb9c0bdde0 2023-03-06T14:16:22.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.240+0000 7fdba139a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0719e0 con 0x7fdb9c14f670 2023-03-06T14:16:22.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.240+0000 7fdba139a700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c1ebf90 con 0x7fdb9c0bda10 2023-03-06T14:16:22.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.241+0000 7fdb9a7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb9c0bdde0 0x7fdb9c1e8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.241+0000 7fdb9a7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb9c0bdde0 0x7fdb9c1e8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56430/0 (socket says 172.21.15.3:56430) 2023-03-06T14:16:22.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.241+0000 7fdb9a7fc700 1 -- 172.21.15.3:0/2825749526 learned_addr learned my addr 172.21.15.3:0/2825749526 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:22.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.241+0000 7fdb9a7fc700 1 -- 172.21.15.3:0/2825749526 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdb9c0bda10 msgr2=0x7fdb9c0714a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-06T14:16:22.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.241+0000 7fdb9a7fc700 1 --2- 172.21.15.3:0/2825749526 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdb9c0bda10 0x7fdb9c0714a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.241+0000 7fdb9a7fc700 1 -- 172.21.15.3:0/2825749526 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb9c14f670 msgr2=0x7fdb9c1e8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.241+0000 7fdb9a7fc700 1 --2- 172.21.15.3:0/2825749526 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb9c14f670 0x7fdb9c1e8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.241+0000 7fdb9a7fc700 1 -- 172.21.15.3:0/2825749526 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9400bd40 con 0x7fdb9c0bdde0 2023-03-06T14:16:22.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.242+0000 7fdb9a7fc700 1 --2- 172.21.15.3:0/2825749526 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb9c0bdde0 0x7fdb9c1e8970 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c00c4a0 tx=0x7fdb8c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.243+0000 7fdb837fe700 1 -- 172.21.15.3:0/2825749526 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c0054e0 con 0x7fdb9c0bdde0 2023-03-06T14:16:22.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.243+0000 7fdb837fe700 1 -- 172.21.15.3:0/2825749526 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c003680 con 0x7fdb9c0bdde0 2023-03-06T14:16:22.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.243+0000 7fdb837fe700 1 -- 172.21.15.3:0/2825749526 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c003a30 con 0x7fdb9c0bdde0 2023-03-06T14:16:22.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.243+0000 7fdba139a700 1 -- 172.21.15.3:0/2825749526 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9c070d40 con 0x7fdb9c0bdde0 2023-03-06T14:16:22.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.243+0000 7fdba139a700 1 -- 172.21.15.3:0/2825749526 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb9c14ec10 con 0x7fdb9c0bdde0 2023-03-06T14:16:22.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.248+0000 7fdb837fe700 1 -- 172.21.15.3:0/2825749526 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdb8c019030 con 0x7fdb9c0bdde0 2023-03-06T14:16:22.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.248+0000 7fdb837fe700 1 --2- 172.21.15.3:0/2825749526 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fdb880683c0 0x7fdb8806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.248+0000 7fdb837fe700 1 -- 172.21.15.3:0/2825749526 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdb8c085280 con 0x7fdb9c0bdde0 2023-03-06T14:16:22.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.249+0000 7fdb9affd700 1 --2- 172.21.15.3:0/2825749526 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fdb880683c0 0x7fdb8806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.249+0000 7fdb9affd700 1 --2- 172.21.15.3:0/2825749526 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fdb880683c0 0x7fdb8806a870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400d4a0 tx=0x7fdb94012000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.250+0000 7fdba139a700 1 -- 172.21.15.3:0/2825749526 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7c0052e0 con 0x7fdb9c0bdde0 2023-03-06T14:16:22.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.259+0000 7fdb837fe700 1 -- 172.21.15.3:0/2825749526 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdb8c04b5e0 con 0x7fdb9c0bdde0 2023-03-06T14:16:22.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.455+0000 7f8cdd22c700 1 -- 172.21.15.3:0/276787131 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8cbc005590 con 0x7f8cd80b69e0 2023-03-06T14:16:22.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.456+0000 7f8cc77fe700 1 -- 172.21.15.3:0/276787131 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8cc8015020 con 0x7f8cd80b69e0 2023-03-06T14:16:22.458 INFO:teuthology.orchestra.run.smithi003.stdout:55834574858 2023-03-06T14:16:22.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.459+0000 7f8cdd22c700 1 -- 172.21.15.3:0/276787131 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f8cc0068550 msgr2=0x7f8cc006aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.459+0000 7f8cdd22c700 1 --2- 172.21.15.3:0/276787131 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f8cc0068550 0x7f8cc006aa00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8cd814b620 tx=0x7f8ccc00d040 comp rx=0 tx=0).stop 2023-03-06T14:16:22.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.459+0000 7f8cdd22c700 1 -- 172.21.15.3:0/276787131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cd80b69e0 msgr2=0x7f8cd81f2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.459+0000 7f8cdd22c700 1 --2- 172.21.15.3:0/276787131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cd80b69e0 0x7f8cd81f2290 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8016000 tx=0x7f8cc8004750 comp rx=0 tx=0).stop 2023-03-06T14:16:22.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.459+0000 7f8cdd22c700 1 -- 172.21.15.3:0/276787131 shutdown_connections 2023-03-06T14:16:22.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.459+0000 7f8cdd22c700 1 --2- 172.21.15.3:0/276787131 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f8cc0068550 0x7f8cc006aa00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.459+0000 7f8cdd22c700 1 --2- 172.21.15.3:0/276787131 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cd814e670 0x7f8cd806e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.459+0000 7f8cdd22c700 1 --2- 172.21.15.3:0/276787131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cd80b69e0 0x7f8cd81f2290 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.459+0000 7f8cdd22c700 1 --2- 172.21.15.3:0/276787131 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cd81488d0 0x7f8cd81e2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.459+0000 7f8cdd22c700 1 -- 172.21.15.3:0/276787131 >> 172.21.15.3:0/276787131 conn(0x7f8cd80c1b40 msgr2=0x7f8cd81e82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:22.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.460+0000 7f8cdd22c700 1 -- 172.21.15.3:0/276787131 shutdown_connections 2023-03-06T14:16:22.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.460+0000 7f8cdd22c700 1 -- 172.21.15.3:0/276787131 wait complete. 2023-03-06T14:16:22.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2023-03-06T14:16:22.480 DEBUG:teuthology.parallel:result is None 2023-03-06T14:16:22.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.537+0000 7fa515f2b700 1 -- 172.21.15.3:0/1825198434 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa4ec005590 con 0x7fa51014e670 2023-03-06T14:16:22.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.537+0000 7efcb5e79700 1 -- 172.21.15.3:0/268347214 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7efcb0143720 con 0x7efcb00b5eb0 2023-03-06T14:16:22.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.537+0000 7fa4fffff700 1 -- 172.21.15.3:0/1825198434 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa504015020 con 0x7fa51014e670 2023-03-06T14:16:22.539 INFO:teuthology.orchestra.run.smithi003.stdout:55834574858 2023-03-06T14:16:22.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.538+0000 7efc97fff700 1 -- 172.21.15.3:0/268347214 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efca80564e0 con 0x7efcb00b5eb0 2023-03-06T14:16:22.540 INFO:teuthology.orchestra.run.smithi003.stdout:55834574859 2023-03-06T14:16:22.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.541+0000 7fa515f2b700 1 -- 172.21.15.3:0/1825198434 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa4f4068390 msgr2=0x7fa4f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.541+0000 7fa515f2b700 1 --2- 172.21.15.3:0/1825198434 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa4f4068390 0x7fa4f406a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa500009630 tx=0x7fa500008030 comp rx=0 tx=0).stop 2023-03-06T14:16:22.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.541+0000 7fa515f2b700 1 -- 172.21.15.3:0/1825198434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa51014e670 msgr2=0x7fa51013ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.541+0000 7fa515f2b700 1 --2- 172.21.15.3:0/1825198434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa51014e670 0x7fa51013ab50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa50400b3e0 tx=0x7fa50400b6f0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.541+0000 7fa515f2b700 1 -- 172.21.15.3:0/1825198434 shutdown_connections 2023-03-06T14:16:22.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.541+0000 7fa515f2b700 1 --2- 172.21.15.3:0/1825198434 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa4f4068390 0x7fa4f406a840 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa500009630 tx=0x7fa500008030 comp rx=0 tx=0).stop 2023-03-06T14:16:22.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.541+0000 7fa515f2b700 1 --2- 172.21.15.3:0/1825198434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa51014e670 0x7fa51013ab50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.541+0000 7fa515f2b700 1 --2- 172.21.15.3:0/1825198434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5100b69e0 0x7fa51013e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.541+0000 7fa515f2b700 1 --2- 172.21.15.3:0/1825198434 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5101488d0 0x7fa5101f5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.541+0000 7fa515f2b700 1 -- 172.21.15.3:0/1825198434 >> 172.21.15.3:0/1825198434 conn(0x7fa5100c1b40 msgr2=0x7fa510142c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:22.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.541+0000 7fa515f2b700 1 -- 172.21.15.3:0/1825198434 shutdown_connections 2023-03-06T14:16:22.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.541+0000 7fa515f2b700 1 -- 172.21.15.3:0/1825198434 wait complete. 2023-03-06T14:16:22.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.542+0000 7efcb5e79700 1 -- 172.21.15.3:0/268347214 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7efc9c0683c0 msgr2=0x7efc9c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.542+0000 7efcb5e79700 1 --2- 172.21.15.3:0/268347214 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7efc9c0683c0 0x7efc9c06a870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efca0000c00 tx=0x7efca0008030 comp rx=0 tx=0).stop 2023-03-06T14:16:22.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.542+0000 7efcb5e79700 1 -- 172.21.15.3:0/268347214 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efcb00b5eb0 msgr2=0x7efcb014ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.542+0000 7efcb5e79700 1 --2- 172.21.15.3:0/268347214 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efcb00b5eb0 0x7efcb014ca30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efca8007f20 tx=0x7efca800e3c0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.542+0000 7efcb5e79700 1 -- 172.21.15.3:0/268347214 shutdown_connections 2023-03-06T14:16:22.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.542+0000 7efcb5e79700 1 --2- 172.21.15.3:0/268347214 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7efc9c0683c0 0x7efc9c06a870 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.542+0000 7efcb5e79700 1 --2- 172.21.15.3:0/268347214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcb00b6f20 0x7efcb006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.542+0000 7efcb5e79700 1 --2- 172.21.15.3:0/268347214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcb00704b0 0x7efcb00b84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.542+0000 7efcb5e79700 1 --2- 172.21.15.3:0/268347214 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efcb00b5eb0 0x7efcb014ca30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.542+0000 7efcb5e79700 1 -- 172.21.15.3:0/268347214 >> 172.21.15.3:0/268347214 conn(0x7efcb00c1b40 msgr2=0x7efcb01441b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:22.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.542+0000 7efcb5e79700 1 -- 172.21.15.3:0/268347214 shutdown_connections 2023-03-06T14:16:22.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.542+0000 7efcb5e79700 1 -- 172.21.15.3:0/268347214 wait complete. 2023-03-06T14:16:22.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2023-03-06T14:16:22.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.561+0000 7fa33f7e6700 1 -- 172.21.15.3:0/1373507557 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa318005150 con 0x7fa33806e8e0 2023-03-06T14:16:22.563 DEBUG:teuthology.parallel:result is None 2023-03-06T14:16:22.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.561+0000 7fa32dffb700 1 -- 172.21.15.3:0/1373507557 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa334015020 con 0x7fa33806e8e0 2023-03-06T14:16:22.564 INFO:teuthology.orchestra.run.smithi003.stdout:55834574858 2023-03-06T14:16:22.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2023-03-06T14:16:22.564 DEBUG:teuthology.parallel:result is None 2023-03-06T14:16:22.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.564+0000 7fa33f7e6700 1 -- 172.21.15.3:0/1373507557 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa31c068340 msgr2=0x7fa31c06a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.564+0000 7fa33f7e6700 1 --2- 172.21.15.3:0/1373507557 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa31c068340 0x7fa31c06a7f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa338139b40 tx=0x7fa328006c60 comp rx=0 tx=0).stop 2023-03-06T14:16:22.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.564+0000 7fa33f7e6700 1 -- 172.21.15.3:0/1373507557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa33806e8e0 msgr2=0x7fa3381594b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.564+0000 7fa33f7e6700 1 --2- 172.21.15.3:0/1373507557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa33806e8e0 0x7fa3381594b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa334000c00 tx=0x7fa334004750 comp rx=0 tx=0).stop 2023-03-06T14:16:22.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.564+0000 7fa33f7e6700 1 -- 172.21.15.3:0/1373507557 shutdown_connections 2023-03-06T14:16:22.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.564+0000 7fa33f7e6700 1 --2- 172.21.15.3:0/1373507557 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fa31c068340 0x7fa31c06a7f0 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa338139b40 tx=0x7fa328006c60 comp rx=0 tx=0).stop 2023-03-06T14:16:22.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.564+0000 7fa33f7e6700 1 --2- 172.21.15.3:0/1373507557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa33806e8e0 0x7fa3381594b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.564+0000 7fa33f7e6700 1 --2- 172.21.15.3:0/1373507557 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa338157020 0x7fa33815cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.564+0000 7fa33f7e6700 1 --2- 172.21.15.3:0/1373507557 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3380a5bc0 0x7fa338156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.564+0000 7fa33f7e6700 1 -- 172.21.15.3:0/1373507557 >> 172.21.15.3:0/1373507557 conn(0x7fa3380c1b40 msgr2=0x7fa338152bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:22.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.565+0000 7fa33f7e6700 1 -- 172.21.15.3:0/1373507557 shutdown_connections 2023-03-06T14:16:22.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.565+0000 7fa33f7e6700 1 -- 172.21.15.3:0/1373507557 wait complete. 2023-03-06T14:16:22.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2023-03-06T14:16:22.579 DEBUG:teuthology.parallel:result is None 2023-03-06T14:16:22.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.590+0000 7fc8530e8700 1 -- 172.21.15.3:0/504510476 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc84c151440 con 0x7fc84c0b80e0 2023-03-06T14:16:22.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.591+0000 7fc8497fa700 1 -- 172.21.15.3:0/504510476 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc844022020 con 0x7fc84c0b80e0 2023-03-06T14:16:22.592 INFO:teuthology.orchestra.run.smithi003.stdout:55834574858 2023-03-06T14:16:22.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.593+0000 7fc8530e8700 1 -- 172.21.15.3:0/504510476 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc830068320 msgr2=0x7fc83006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.593+0000 7fc8530e8700 1 --2- 172.21.15.3:0/504510476 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc830068320 0x7fc83006a7d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc840009ae0 tx=0x7fc840008040 comp rx=0 tx=0).stop 2023-03-06T14:16:22.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.593+0000 7fc8530e8700 1 -- 172.21.15.3:0/504510476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc84c0b80e0 msgr2=0x7fc84c131f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.593+0000 7fc8530e8700 1 --2- 172.21.15.3:0/504510476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc84c0b80e0 0x7fc84c131f80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc84400b680 tx=0x7fc844004ad0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.593+0000 7fc8530e8700 1 -- 172.21.15.3:0/504510476 shutdown_connections 2023-03-06T14:16:22.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.593+0000 7fc8530e8700 1 --2- 172.21.15.3:0/504510476 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc830068320 0x7fc83006a7d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.593+0000 7fc8530e8700 1 --2- 172.21.15.3:0/504510476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc84c0b80e0 0x7fc84c131f80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.593+0000 7fc8530e8700 1 --2- 172.21.15.3:0/504510476 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc84c0a2ec0 0x7fc84c0a6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.593+0000 7fc8530e8700 1 --2- 172.21.15.3:0/504510476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc84c0b77d0 0x7fc84c06b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.593+0000 7fc8530e8700 1 -- 172.21.15.3:0/504510476 >> 172.21.15.3:0/504510476 conn(0x7fc84c0c17d0 msgr2=0x7fc84c071ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:22.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.594+0000 7fc8530e8700 1 -- 172.21.15.3:0/504510476 shutdown_connections 2023-03-06T14:16:22.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.594+0000 7fc8530e8700 1 -- 172.21.15.3:0/504510476 wait complete. 2023-03-06T14:16:22.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.600+0000 7f1727fee700 1 -- 172.21.15.3:0/467183460 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f172004e6e0 con 0x7f172014a0d0 2023-03-06T14:16:22.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.601+0000 7f17167fc700 1 -- 172.21.15.3:0/467183460 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f171c021020 con 0x7f172014a0d0 2023-03-06T14:16:22.602 INFO:teuthology.orchestra.run.smithi003.stdout:55834574859 2023-03-06T14:16:22.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.604+0000 7f1727fee700 1 -- 172.21.15.3:0/467183460 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f17040683c0 msgr2=0x7f170406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.604+0000 7f1727fee700 1 --2- 172.21.15.3:0/467183460 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f17040683c0 0x7f170406a870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1710001750 tx=0x7f1710009040 comp rx=0 tx=0).stop 2023-03-06T14:16:22.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.604+0000 7f1727fee700 1 -- 172.21.15.3:0/467183460 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f172014a0d0 msgr2=0x7f172006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.604+0000 7f1727fee700 1 --2- 172.21.15.3:0/467183460 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f172014a0d0 0x7f172006d7f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f171c00e950 tx=0x7f171c00ed10 comp rx=0 tx=0).stop 2023-03-06T14:16:22.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.605+0000 7f1727fee700 1 -- 172.21.15.3:0/467183460 shutdown_connections 2023-03-06T14:16:22.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.605+0000 7f1727fee700 1 --2- 172.21.15.3:0/467183460 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f17040683c0 0x7f170406a870 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.605+0000 7f1727fee700 1 --2- 172.21.15.3:0/467183460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1720071ed0 0x7f172014fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.605+0000 7f1727fee700 1 --2- 172.21.15.3:0/467183460 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f172014a0d0 0x7f172006d7f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.605+0000 7f1727fee700 1 --2- 172.21.15.3:0/467183460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1720149d00 0x7f17200bab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.605+0000 7f1727fee700 1 -- 172.21.15.3:0/467183460 >> 172.21.15.3:0/467183460 conn(0x7f17200c0eb0 msgr2=0x7f17200bf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:22.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.605+0000 7f1727fee700 1 -- 172.21.15.3:0/467183460 shutdown_connections 2023-03-06T14:16:22.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.605+0000 7f1727fee700 1 -- 172.21.15.3:0/467183460 wait complete. 2023-03-06T14:16:22.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2023-03-06T14:16:22.608 DEBUG:teuthology.parallel:result is None 2023-03-06T14:16:22.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.611+0000 7f0a12fca700 1 -- 172.21.15.3:0/2384290237 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f09ec005590 con 0x7f0a0c0baf70 2023-03-06T14:16:22.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.611+0000 7f0a097fa700 1 -- 172.21.15.3:0/2384290237 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f09f8055990 con 0x7f0a0c0baf70 2023-03-06T14:16:22.613 INFO:teuthology.orchestra.run.smithi003.stdout:55834574860 2023-03-06T14:16:22.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.614+0000 7f0a12fca700 1 -- 172.21.15.3:0/2384290237 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f09f0068340 msgr2=0x7f09f006a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.614+0000 7f0a12fca700 1 --2- 172.21.15.3:0/2384290237 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f09f0068340 0x7f09f006a7f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c068ae0 tx=0x7f0a00006cd0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.614+0000 7f0a12fca700 1 -- 172.21.15.3:0/2384290237 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a0c0baf70 msgr2=0x7f0a0c141680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.614+0000 7f0a12fca700 1 --2- 172.21.15.3:0/2384290237 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a0c0baf70 0x7f0a0c141680 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f09f8007290 tx=0x7f09f8007650 comp rx=0 tx=0).stop 2023-03-06T14:16:22.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.614+0000 7f0a12fca700 1 -- 172.21.15.3:0/2384290237 shutdown_connections 2023-03-06T14:16:22.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.614+0000 7f0a12fca700 1 --2- 172.21.15.3:0/2384290237 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f09f0068340 0x7f09f006a7f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.614+0000 7f0a12fca700 1 --2- 172.21.15.3:0/2384290237 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a0c13cd30 0x7f0a0c0b8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.614+0000 7f0a12fca700 1 --2- 172.21.15.3:0/2384290237 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09fc005300 0x7f0a0c0b9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.614+0000 7f0a12fca700 1 --2- 172.21.15.3:0/2384290237 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a0c0baf70 0x7f0a0c141680 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.614+0000 7f0a12fca700 1 -- 172.21.15.3:0/2384290237 >> 172.21.15.3:0/2384290237 conn(0x7f0a0c0c0eb0 msgr2=0x7f0a0c0bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:22.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.614+0000 7f0a12fca700 1 -- 172.21.15.3:0/2384290237 shutdown_connections 2023-03-06T14:16:22.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.614+0000 7f0a12fca700 1 -- 172.21.15.3:0/2384290237 wait complete. 2023-03-06T14:16:22.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2023-03-06T14:16:22.624 DEBUG:teuthology.parallel:result is None 2023-03-06T14:16:22.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.624+0000 7fdba139a700 1 -- 172.21.15.3:0/2825749526 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdb7c005590 con 0x7fdb9c0bdde0 2023-03-06T14:16:22.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.625+0000 7fdb837fe700 1 -- 172.21.15.3:0/2825749526 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdb8c017070 con 0x7fdb9c0bdde0 2023-03-06T14:16:22.626 INFO:teuthology.orchestra.run.smithi003.stdout:55834574860 2023-03-06T14:16:22.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.627+0000 7fdba139a700 1 -- 172.21.15.3:0/2825749526 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fdb880683c0 msgr2=0x7fdb8806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.627+0000 7fdba139a700 1 --2- 172.21.15.3:0/2825749526 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fdb880683c0 0x7fdb8806a870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400d4a0 tx=0x7fdb94012000 comp rx=0 tx=0).stop 2023-03-06T14:16:22.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.627+0000 7fdba139a700 1 -- 172.21.15.3:0/2825749526 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb9c0bdde0 msgr2=0x7fdb9c1e8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.627+0000 7fdba139a700 1 --2- 172.21.15.3:0/2825749526 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb9c0bdde0 0x7fdb9c1e8970 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c00c4a0 tx=0x7fdb8c00c860 comp rx=0 tx=0).stop 2023-03-06T14:16:22.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.627+0000 7fdba139a700 1 -- 172.21.15.3:0/2825749526 shutdown_connections 2023-03-06T14:16:22.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.627+0000 7fdba139a700 1 --2- 172.21.15.3:0/2825749526 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fdb880683c0 0x7fdb8806a870 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.627+0000 7fdba139a700 1 --2- 172.21.15.3:0/2825749526 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb9c14f670 0x7fdb9c1e8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.627+0000 7fdba139a700 1 --2- 172.21.15.3:0/2825749526 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdb9c0bda10 0x7fdb9c0714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.627+0000 7fdba139a700 1 --2- 172.21.15.3:0/2825749526 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb9c0bdde0 0x7fdb9c1e8970 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.627+0000 7fdba139a700 1 -- 172.21.15.3:0/2825749526 >> 172.21.15.3:0/2825749526 conn(0x7fdb9c0c17d0 msgr2=0x7fdb9c1439c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:22.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.627+0000 7fdba139a700 1 -- 172.21.15.3:0/2825749526 shutdown_connections 2023-03-06T14:16:22.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.627+0000 7fdba139a700 1 -- 172.21.15.3:0/2825749526 wait complete. 2023-03-06T14:16:22.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.3 2023-03-06T14:16:22.631 DEBUG:teuthology.parallel:result is None 2023-03-06T14:16:22.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.0 2023-03-06T14:16:22.641 DEBUG:teuthology.parallel:result is None 2023-03-06T14:16:22.642 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-03-06T14:16:22.642 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-06T14:16:22.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.803+0000 7f552e4ec700 1 Processor -- start 2023-03-06T14:16:22.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.803+0000 7f552e4ec700 1 -- start start 2023-03-06T14:16:22.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.804+0000 7f552e4ec700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f55280bdde0 0x7f5528145420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.804+0000 7f552e4ec700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55280a2ea0 0x7f5528155e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.804+0000 7f552e4ec700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5528072a30 con 0x7f55280bda10 2023-03-06T14:16:22.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.804+0000 7f552e4ec700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552806e9b0 con 0x7f55280bdde0 2023-03-06T14:16:22.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.804+0000 7f552e4ec700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552806f670 con 0x7f55280a2ea0 2023-03-06T14:16:22.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.804+0000 7f55277fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f55280bdde0 0x7f5528145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.804+0000 7f552ca89700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55280a2ea0 0x7f5528155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.804+0000 7f55277fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f55280bdde0 0x7f5528145420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.3:42530/0 (socket says 172.21.15.3:42530) 2023-03-06T14:16:22.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.804+0000 7f55277fe700 1 -- 172.21.15.3:0/4238022965 learned_addr learned my addr 172.21.15.3:0/4238022965 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:22.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.804+0000 7f552ca89700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55280a2ea0 0x7f5528155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.3:49422/0 (socket says 172.21.15.3:49422) 2023-03-06T14:16:22.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.804+0000 7f5527fff700 1 --1- 172.21.15.3:0/4238022965 >> v1:172.21.15.136:6789/0 conn(0x7f55280bda10 0x7f552814f130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.3:56196/0 (socket says 172.21.15.3:56196) 2023-03-06T14:16:22.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.805+0000 7f55277fe700 1 -- 172.21.15.3:0/4238022965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55280a2ea0 msgr2=0x7f5528155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:22.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.805+0000 7f55277fe700 1 --2- 172.21.15.3:0/4238022965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55280a2ea0 0x7f5528155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.805+0000 7f55277fe700 1 -- 172.21.15.3:0/4238022965 >> v1:172.21.15.136:6789/0 conn(0x7f55280bda10 legacy=0x7f552814f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.805+0000 7f55277fe700 1 -- 172.21.15.3:0/4238022965 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552806f0f0 con 0x7f55280bdde0 2023-03-06T14:16:22.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.805+0000 7f552ca89700 1 --2- 172.21.15.3:0/4238022965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55280a2ea0 0x7f5528155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:16:22.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.805+0000 7f55277fe700 1 --2- 172.21.15.3:0/4238022965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55280bdde0 0x7f5528145420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f551c00bb90 tx=0x7f551c00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92b7a8666448970 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.805+0000 7f5526ffd700 1 -- 172.21.15.3:0/4238022965 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c00dd30 con 0x7f55280bdde0 2023-03-06T14:16:22.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.805+0000 7f5526ffd700 1 -- 172.21.15.3:0/4238022965 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551c00de90 con 0x7f55280bdde0 2023-03-06T14:16:22.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.805+0000 7f5526ffd700 1 -- 172.21.15.3:0/4238022965 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c010690 con 0x7f55280bdde0 2023-03-06T14:16:22.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.806+0000 7f552e4ec700 1 -- 172.21.15.3:0/4238022965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55280bdde0 msgr2=0x7f5528145420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.806+0000 7f552e4ec700 1 --2- 172.21.15.3:0/4238022965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55280bdde0 0x7f5528145420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f551c00bb90 tx=0x7f551c00bea0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.806+0000 7f552e4ec700 1 -- 172.21.15.3:0/4238022965 shutdown_connections 2023-03-06T14:16:22.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.806+0000 7f552e4ec700 1 --2- 172.21.15.3:0/4238022965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55280a2ea0 0x7f5528155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.806+0000 7f552e4ec700 1 --2- 172.21.15.3:0/4238022965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55280bdde0 0x7f5528145420 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.806+0000 7f552e4ec700 1 -- 172.21.15.3:0/4238022965 >> 172.21.15.3:0/4238022965 conn(0x7f55280c17d0 msgr2=0x7f55280c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:22.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.806+0000 7f552e4ec700 1 -- 172.21.15.3:0/4238022965 shutdown_connections 2023-03-06T14:16:22.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.806+0000 7f552e4ec700 1 -- 172.21.15.3:0/4238022965 wait complete. 2023-03-06T14:16:22.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.807+0000 7f552e4ec700 1 Processor -- start 2023-03-06T14:16:22.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.807+0000 7f552e4ec700 1 -- start start 2023-03-06T14:16:22.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f552e4ec700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55280a2ea0 0x7f5528141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f552e4ec700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55280bda10 0x7f55280b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f552e4ec700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55280bdde0 0x7f55280b7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f552e4ec700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55281e4280 con 0x7f55280bda10 2023-03-06T14:16:22.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f552e4ec700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55280b67a0 con 0x7f55280bdde0 2023-03-06T14:16:22.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f552e4ec700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55281417c0 con 0x7f55280a2ea0 2023-03-06T14:16:22.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f55277fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55280bda10 0x7f55280b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f55277fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55280bda10 0x7f55280b6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56446/0 (socket says 172.21.15.3:56446) 2023-03-06T14:16:22.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f55277fe700 1 -- 172.21.15.3:0/1346722399 learned_addr learned my addr 172.21.15.3:0/1346722399 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:22.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f5527fff700 1 --2- 172.21.15.3:0/1346722399 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55280a2ea0 0x7f5528141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f552ca89700 1 --2- 172.21.15.3:0/1346722399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55280bdde0 0x7f55280b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f55277fe700 1 -- 172.21.15.3:0/1346722399 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55280a2ea0 msgr2=0x7f5528141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f55277fe700 1 --2- 172.21.15.3:0/1346722399 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55280a2ea0 0x7f5528141280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f55277fe700 1 -- 172.21.15.3:0/1346722399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55280bdde0 msgr2=0x7f55280b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:22.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f55277fe700 1 --2- 172.21.15.3:0/1346722399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55280bdde0 0x7f55280b7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:22.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f55277fe700 1 -- 172.21.15.3:0/1346722399 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5520009a70 con 0x7f55280bda10 2023-03-06T14:16:22.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f5527fff700 1 --2- 172.21.15.3:0/1346722399 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55280a2ea0 0x7f5528141280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:22.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f55277fe700 1 --2- 172.21.15.3:0/1346722399 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55280bda10 0x7f55280b6c30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f551c00bee0 tx=0x7f551c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f5524ff9700 1 -- 172.21.15.3:0/1346722399 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c003cf0 con 0x7f55280bda10 2023-03-06T14:16:22.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f5524ff9700 1 -- 172.21.15.3:0/1346722399 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551c003e70 con 0x7f55280bda10 2023-03-06T14:16:22.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f552e4ec700 1 -- 172.21.15.3:0/1346722399 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551c00b7f0 con 0x7f55280bda10 2023-03-06T14:16:22.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.808+0000 7f5524ff9700 1 -- 172.21.15.3:0/1346722399 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c010690 con 0x7f55280bda10 2023-03-06T14:16:22.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.809+0000 7f552e4ec700 1 -- 172.21.15.3:0/1346722399 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552814ec10 con 0x7f55280bda10 2023-03-06T14:16:22.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.810+0000 7f552e4ec700 1 -- 172.21.15.3:0/1346722399 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552806f390 con 0x7f55280bda10 2023-03-06T14:16:22.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.810+0000 7f5524ff9700 1 -- 172.21.15.3:0/1346722399 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f551c019400 con 0x7f55280bda10 2023-03-06T14:16:22.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.810+0000 7f5524ff9700 1 --2- 172.21.15.3:0/1346722399 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f5514068320 0x7f551406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:22.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.811+0000 7f5524ff9700 1 -- 172.21.15.3:0/1346722399 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f551c0870a0 con 0x7f55280bda10 2023-03-06T14:16:22.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.811+0000 7f5527fff700 1 --2- 172.21.15.3:0/1346722399 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f5514068320 0x7f551406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:22.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.811+0000 7f5527fff700 1 --2- 172.21.15.3:0/1346722399 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f5514068320 0x7f551406a7d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5518000f60 tx=0x7f5518007dd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:22.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:22.815+0000 7f5524ff9700 1 -- 172.21.15.3:0/1346722399 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f551c0535b0 con 0x7f55280bda10 2023-03-06T14:16:23.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.002+0000 7f552e4ec700 1 -- 172.21.15.3:0/1346722399 --> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5528070d40 con 0x7f5514068320 2023-03-06T14:16:23.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.013+0000 7f5524ff9700 1 -- 172.21.15.3:0/1346722399 <== mgr.4107 v2:172.21.15.136:6832/96144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367254 (secure 0 0 0) 0x7f5528070d40 con 0x7f5514068320 2023-03-06T14:16:23.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:23.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.016+0000 7f552e4ec700 1 -- 172.21.15.3:0/1346722399 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f5514068320 msgr2=0x7f551406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:23.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.016+0000 7f552e4ec700 1 --2- 172.21.15.3:0/1346722399 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f5514068320 0x7f551406a7d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5518000f60 tx=0x7f5518007dd0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.016+0000 7f552e4ec700 1 -- 172.21.15.3:0/1346722399 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55280bda10 msgr2=0x7f55280b6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:23.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.016+0000 7f552e4ec700 1 --2- 172.21.15.3:0/1346722399 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55280bda10 0x7f55280b6c30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f551c00bee0 tx=0x7f551c004750 comp rx=0 tx=0).stop 2023-03-06T14:16:23.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.016+0000 7f552e4ec700 1 -- 172.21.15.3:0/1346722399 shutdown_connections 2023-03-06T14:16:23.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.016+0000 7f552e4ec700 1 --2- 172.21.15.3:0/1346722399 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f5514068320 0x7f551406a7d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.016+0000 7f552e4ec700 1 --2- 172.21.15.3:0/1346722399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55280bdde0 0x7f55280b7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.016+0000 7f552e4ec700 1 --2- 172.21.15.3:0/1346722399 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55280a2ea0 0x7f5528141280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.016+0000 7f552e4ec700 1 --2- 172.21.15.3:0/1346722399 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55280bda10 0x7f55280b6c30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.016+0000 7f552e4ec700 1 -- 172.21.15.3:0/1346722399 >> 172.21.15.3:0/1346722399 conn(0x7f55280c17d0 msgr2=0x7f5528144170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:23.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.016+0000 7f552e4ec700 1 -- 172.21.15.3:0/1346722399 shutdown_connections 2023-03-06T14:16:23.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.016+0000 7f552e4ec700 1 -- 172.21.15.3:0/1346722399 wait complete. 2023-03-06T14:16:23.022 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-03-06T14:16:23.030 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-03-06T14:16:22.970954+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594896,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67496,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907224,"statfs":{"total":773094113280,"available":773024997376,"internally_reserved":0,"allocated":3579904,"data_stored":2149000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003819"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633630+0000","last_change":"2023-03-06T14:15:58.616190+0000","last_active":"2023-03-06T14:16:02.633630+0000","last_peered":"2023-03-06T14:16:02.633630+0000","last_clean":"2023-03-06T14:16:02.633630+0000","last_became_active":"2023-03-06T14:15:58.615955+0000","last_became_peered":"2023-03-06T14:15:58.615955+0000","last_unstale":"2023-03-06T14:16:02.633630+0000","last_undegraded":"2023-03-06T14:16:02.633630+0000","last_fullsized":"2023-03-06T14:16:02.633630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:30:51.239540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622862+0000","last_change":"2023-03-06T14:15:58.627806+0000","last_active":"2023-03-06T14:16:02.622862+0000","last_peered":"2023-03-06T14:16:02.622862+0000","last_clean":"2023-03-06T14:16:02.622862+0000","last_became_active":"2023-03-06T14:15:58.627569+0000","last_became_peered":"2023-03-06T14:15:58.627569+0000","last_unstale":"2023-03-06T14:16:02.622862+0000","last_undegraded":"2023-03-06T14:16:02.622862+0000","last_fullsized":"2023-03-06T14:16:02.622862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:11:22.678656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.624921+0000","last_change":"2023-03-06T14:15:58.620909+0000","last_active":"2023-03-06T14:16:02.624921+0000","last_peered":"2023-03-06T14:16:02.624921+0000","last_clean":"2023-03-06T14:16:02.624921+0000","last_became_active":"2023-03-06T14:15:58.620552+0000","last_became_peered":"2023-03-06T14:15:58.620552+0000","last_unstale":"2023-03-06T14:16:02.624921+0000","last_undegraded":"2023-03-06T14:16:02.624921+0000","last_fullsized":"2023-03-06T14:16:02.624921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:20:36.299681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.627858+0000","last_change":"2023-03-06T14:15:58.620841+0000","last_active":"2023-03-06T14:16:02.627858+0000","last_peered":"2023-03-06T14:16:02.627858+0000","last_clean":"2023-03-06T14:16:02.627858+0000","last_became_active":"2023-03-06T14:15:58.620520+0000","last_became_peered":"2023-03-06T14:15:58.620520+0000","last_unstale":"2023-03-06T14:16:02.627858+0000","last_undegraded":"2023-03-06T14:16:02.627858+0000","last_fullsized":"2023-03-06T14:16:02.627858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:48:05.347666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.634738+0000","last_change":"2023-03-06T14:15:58.617864+0000","last_active":"2023-03-06T14:16:02.634738+0000","last_peered":"2023-03-06T14:16:02.634738+0000","last_clean":"2023-03-06T14:16:02.634738+0000","last_became_active":"2023-03-06T14:15:58.617583+0000","last_became_peered":"2023-03-06T14:15:58.617583+0000","last_unstale":"2023-03-06T14:16:02.634738+0000","last_undegraded":"2023-03-06T14:16:02.634738+0000","last_fullsized":"2023-03-06T14:16:02.634738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:38.013992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623747+0000","last_change":"2023-03-06T14:15:58.622023+0000","last_active":"2023-03-06T14:16:02.623747+0000","last_peered":"2023-03-06T14:16:02.623747+0000","last_clean":"2023-03-06T14:16:02.623747+0000","last_became_active":"2023-03-06T14:15:58.621701+0000","last_became_peered":"2023-03-06T14:15:58.621701+0000","last_unstale":"2023-03-06T14:16:02.623747+0000","last_undegraded":"2023-03-06T14:16:02.623747+0000","last_fullsized":"2023-03-06T14:16:02.623747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:30:29.679092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633939+0000","last_change":"2023-03-06T14:15:58.628504+0000","last_active":"2023-03-06T14:16:02.633939+0000","last_peered":"2023-03-06T14:16:02.633939+0000","last_clean":"2023-03-06T14:16:02.633939+0000","last_became_active":"2023-03-06T14:15:58.625498+0000","last_became_peered":"2023-03-06T14:15:58.625498+0000","last_unstale":"2023-03-06T14:16:02.633939+0000","last_undegraded":"2023-03-06T14:16:02.633939+0000","last_fullsized":"2023-03-06T14:16:02.633939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621014+0000","last_change":"2023-03-06T14:15:58.623919+0000","last_active":"2023-03-06T14:16:02.621014+0000","last_peered":"2023-03-06T14:16:02.621014+0000","last_clean":"2023-03-06T14:16:02.621014+0000","last_became_active":"2023-03-06T14:15:58.623649+0000","last_became_peered":"2023-03-06T14:15:58.623649+0000","last_unstale":"2023-03-06T14:16:02.621014+0000","last_undegraded":"2023-03-06T14:16:02.621014+0000","last_fullsized":"2023-03-06T14:16:02.621014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633659+0000","last_change":"2023-03-06T14:15:58.620112+0000","last_active":"2023-03-06T14:16:02.633659+0000","last_peered":"2023-03-06T14:16:02.633659+0000","last_clean":"2023-03-06T14:16:02.633659+0000","last_became_active":"2023-03-06T14:15:58.619883+0000","last_became_peered":"2023-03-06T14:15:58.619883+0000","last_unstale":"2023-03-06T14:16:02.633659+0000","last_undegraded":"2023-03-06T14:16:02.633659+0000","last_fullsized":"2023-03-06T14:16:02.633659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:37:30.914574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622801+0000","last_change":"2023-03-06T14:15:58.621910+0000","last_active":"2023-03-06T14:16:02.622801+0000","last_peered":"2023-03-06T14:16:02.622801+0000","last_clean":"2023-03-06T14:16:02.622801+0000","last_became_active":"2023-03-06T14:15:58.621587+0000","last_became_peered":"2023-03-06T14:15:58.621587+0000","last_unstale":"2023-03-06T14:16:02.622801+0000","last_undegraded":"2023-03-06T14:16:02.622801+0000","last_fullsized":"2023-03-06T14:16:02.622801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:38.013992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.624901+0000","last_change":"2023-03-06T14:15:58.624755+0000","last_active":"2023-03-06T14:16:02.624901+0000","last_peered":"2023-03-06T14:16:02.624901+0000","last_clean":"2023-03-06T14:16:02.624901+0000","last_became_active":"2023-03-06T14:15:58.624475+0000","last_became_peered":"2023-03-06T14:15:58.624475+0000","last_unstale":"2023-03-06T14:16:02.624901+0000","last_undegraded":"2023-03-06T14:16:02.624901+0000","last_fullsized":"2023-03-06T14:16:02.624901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:18:07.721373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633699+0000","last_change":"2023-03-06T14:15:58.614740+0000","last_active":"2023-03-06T14:16:02.633699+0000","last_peered":"2023-03-06T14:16:02.633699+0000","last_clean":"2023-03-06T14:16:02.633699+0000","last_became_active":"2023-03-06T14:15:58.614438+0000","last_became_peered":"2023-03-06T14:15:58.614438+0000","last_unstale":"2023-03-06T14:16:02.633699+0000","last_undegraded":"2023-03-06T14:16:02.633699+0000","last_fullsized":"2023-03-06T14:16:02.633699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:01:52.021250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633994+0000","last_change":"2023-03-06T14:15:58.616660+0000","last_active":"2023-03-06T14:16:02.633994+0000","last_peered":"2023-03-06T14:16:02.633994+0000","last_clean":"2023-03-06T14:16:02.633994+0000","last_became_active":"2023-03-06T14:15:58.616421+0000","last_became_peered":"2023-03-06T14:15:58.616421+0000","last_unstale":"2023-03-06T14:16:02.633994+0000","last_undegraded":"2023-03-06T14:16:02.633994+0000","last_fullsized":"2023-03-06T14:16:02.633994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:36.384280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620650+0000","last_change":"2023-03-06T14:15:58.621829+0000","last_active":"2023-03-06T14:16:02.620650+0000","last_peered":"2023-03-06T14:16:02.620650+0000","last_clean":"2023-03-06T14:16:02.620650+0000","last_became_active":"2023-03-06T14:15:58.621536+0000","last_became_peered":"2023-03-06T14:15:58.621536+0000","last_unstale":"2023-03-06T14:16:02.620650+0000","last_undegraded":"2023-03-06T14:16:02.620650+0000","last_fullsized":"2023-03-06T14:16:02.620650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:07:29.050347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633730+0000","last_change":"2023-03-06T14:15:58.628671+0000","last_active":"2023-03-06T14:16:02.633730+0000","last_peered":"2023-03-06T14:16:02.633730+0000","last_clean":"2023-03-06T14:16:02.633730+0000","last_became_active":"2023-03-06T14:15:58.625890+0000","last_became_peered":"2023-03-06T14:15:58.625890+0000","last_unstale":"2023-03-06T14:16:02.633730+0000","last_undegraded":"2023-03-06T14:16:02.633730+0000","last_fullsized":"2023-03-06T14:16:02.633730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:52:46.916668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621598+0000","last_change":"2023-03-06T14:15:58.619050+0000","last_active":"2023-03-06T14:16:02.621598+0000","last_peered":"2023-03-06T14:16:02.621598+0000","last_clean":"2023-03-06T14:16:02.621598+0000","last_became_active":"2023-03-06T14:15:58.618773+0000","last_became_peered":"2023-03-06T14:15:58.618773+0000","last_unstale":"2023-03-06T14:16:02.621598+0000","last_undegraded":"2023-03-06T14:16:02.621598+0000","last_fullsized":"2023-03-06T14:16:02.621598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:02.198113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633760+0000","last_change":"2023-03-06T14:15:58.618365+0000","last_active":"2023-03-06T14:16:02.633760+0000","last_peered":"2023-03-06T14:16:02.633760+0000","last_clean":"2023-03-06T14:16:02.633760+0000","last_became_active":"2023-03-06T14:15:58.618051+0000","last_became_peered":"2023-03-06T14:15:58.618051+0000","last_unstale":"2023-03-06T14:16:02.633760+0000","last_undegraded":"2023-03-06T14:16:02.633760+0000","last_fullsized":"2023-03-06T14:16:02.633760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.625083+0000","last_change":"2023-03-06T14:15:58.619631+0000","last_active":"2023-03-06T14:16:02.625083+0000","last_peered":"2023-03-06T14:16:02.625083+0000","last_clean":"2023-03-06T14:16:02.625083+0000","last_became_active":"2023-03-06T14:15:58.619269+0000","last_became_peered":"2023-03-06T14:15:58.619269+0000","last_unstale":"2023-03-06T14:16:02.625083+0000","last_undegraded":"2023-03-06T14:16:02.625083+0000","last_fullsized":"2023-03-06T14:16:02.625083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:37:25.467445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633840+0000","last_change":"2023-03-06T14:15:58.626814+0000","last_active":"2023-03-06T14:16:02.633840+0000","last_peered":"2023-03-06T14:16:02.633840+0000","last_clean":"2023-03-06T14:16:02.633840+0000","last_became_active":"2023-03-06T14:15:58.626375+0000","last_became_peered":"2023-03-06T14:15:58.626375+0000","last_unstale":"2023-03-06T14:16:02.633840+0000","last_undegraded":"2023-03-06T14:16:02.633840+0000","last_fullsized":"2023-03-06T14:16:02.633840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:52.649365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.624599+0000","last_change":"2023-03-06T14:15:58.612672+0000","last_active":"2023-03-06T14:16:02.624599+0000","last_peered":"2023-03-06T14:16:02.624599+0000","last_clean":"2023-03-06T14:16:02.624599+0000","last_became_active":"2023-03-06T14:15:58.612397+0000","last_became_peered":"2023-03-06T14:15:58.612397+0000","last_unstale":"2023-03-06T14:16:02.624599+0000","last_undegraded":"2023-03-06T14:16:02.624599+0000","last_fullsized":"2023-03-06T14:16:02.624599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:11:35.054920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631524+0000","last_change":"2023-03-06T14:15:58.633204+0000","last_active":"2023-03-06T14:16:02.631524+0000","last_peered":"2023-03-06T14:16:02.631524+0000","last_clean":"2023-03-06T14:16:02.631524+0000","last_became_active":"2023-03-06T14:15:58.632916+0000","last_became_peered":"2023-03-06T14:15:58.632916+0000","last_unstale":"2023-03-06T14:16:02.631524+0000","last_undegraded":"2023-03-06T14:16:02.631524+0000","last_fullsized":"2023-03-06T14:16:02.631524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.626753+0000","last_change":"2023-03-06T14:15:58.626811+0000","last_active":"2023-03-06T14:16:02.626753+0000","last_peered":"2023-03-06T14:16:02.626753+0000","last_clean":"2023-03-06T14:16:02.626753+0000","last_became_active":"2023-03-06T14:15:58.626343+0000","last_became_peered":"2023-03-06T14:15:58.626343+0000","last_unstale":"2023-03-06T14:16:02.626753+0000","last_undegraded":"2023-03-06T14:16:02.626753+0000","last_fullsized":"2023-03-06T14:16:02.626753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:38:05.275651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620103+0000","last_change":"2023-03-06T14:15:58.619060+0000","last_active":"2023-03-06T14:16:02.620103+0000","last_peered":"2023-03-06T14:16:02.620103+0000","last_clean":"2023-03-06T14:16:02.620103+0000","last_became_active":"2023-03-06T14:15:58.618364+0000","last_became_peered":"2023-03-06T14:15:58.618364+0000","last_unstale":"2023-03-06T14:16:02.620103+0000","last_undegraded":"2023-03-06T14:16:02.620103+0000","last_fullsized":"2023-03-06T14:16:02.620103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:10:40.167591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631039+0000","last_change":"2023-03-06T14:15:58.633217+0000","last_active":"2023-03-06T14:16:02.631039+0000","last_peered":"2023-03-06T14:16:02.631039+0000","last_clean":"2023-03-06T14:16:02.631039+0000","last_became_active":"2023-03-06T14:15:58.632914+0000","last_became_peered":"2023-03-06T14:15:58.632914+0000","last_unstale":"2023-03-06T14:16:02.631039+0000","last_undegraded":"2023-03-06T14:16:02.631039+0000","last_fullsized":"2023-03-06T14:16:02.631039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637804+0000","last_change":"2023-03-06T14:15:58.623997+0000","last_active":"2023-03-06T14:16:02.637804+0000","last_peered":"2023-03-06T14:16:02.637804+0000","last_clean":"2023-03-06T14:16:02.637804+0000","last_became_active":"2023-03-06T14:15:58.623647+0000","last_became_peered":"2023-03-06T14:15:58.623647+0000","last_unstale":"2023-03-06T14:16:02.637804+0000","last_undegraded":"2023-03-06T14:16:02.637804+0000","last_fullsized":"2023-03-06T14:16:02.637804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:07:29.050347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637576+0000","last_change":"2023-03-06T14:15:58.627972+0000","last_active":"2023-03-06T14:16:02.637576+0000","last_peered":"2023-03-06T14:16:02.637576+0000","last_clean":"2023-03-06T14:16:02.637576+0000","last_became_active":"2023-03-06T14:15:58.624590+0000","last_became_peered":"2023-03-06T14:15:58.624590+0000","last_unstale":"2023-03-06T14:16:02.637576+0000","last_undegraded":"2023-03-06T14:16:02.637576+0000","last_fullsized":"2023-03-06T14:16:02.637576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623548+0000","last_change":"2023-03-06T14:15:58.630237+0000","last_active":"2023-03-06T14:16:02.623548+0000","last_peered":"2023-03-06T14:16:02.623548+0000","last_clean":"2023-03-06T14:16:02.623548+0000","last_became_active":"2023-03-06T14:15:58.629950+0000","last_became_peered":"2023-03-06T14:15:58.629950+0000","last_unstale":"2023-03-06T14:16:02.623548+0000","last_undegraded":"2023-03-06T14:16:02.623548+0000","last_fullsized":"2023-03-06T14:16:02.623548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.355023+0000","last_change":"2023-03-06T14:16:02.646596+0000","last_active":"2023-03-06T14:16:03.355023+0000","last_peered":"2023-03-06T14:16:03.355023+0000","last_clean":"2023-03-06T14:16:03.355023+0000","last_became_active":"2023-03-06T14:16:02.646087+0000","last_became_peered":"2023-03-06T14:16:02.646087+0000","last_unstale":"2023-03-06T14:16:03.355023+0000","last_undegraded":"2023-03-06T14:16:03.355023+0000","last_fullsized":"2023-03-06T14:16:03.355023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:06:47.997273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623579+0000","last_change":"2023-03-06T14:15:58.199019+0000","last_active":"2023-03-06T14:16:02.623579+0000","last_peered":"2023-03-06T14:16:02.623579+0000","last_clean":"2023-03-06T14:16:02.623579+0000","last_became_active":"2023-03-06T14:15:58.198549+0000","last_became_peered":"2023-03-06T14:15:58.198549+0000","last_unstale":"2023-03-06T14:16:02.623579+0000","last_undegraded":"2023-03-06T14:16:02.623579+0000","last_fullsized":"2023-03-06T14:16:02.623579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:38:41.806931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620438+0000","last_change":"2023-03-06T14:15:58.624265+0000","last_active":"2023-03-06T14:16:02.620438+0000","last_peered":"2023-03-06T14:16:02.620438+0000","last_clean":"2023-03-06T14:16:02.620438+0000","last_became_active":"2023-03-06T14:15:58.624013+0000","last_became_peered":"2023-03-06T14:15:58.624013+0000","last_unstale":"2023-03-06T14:16:02.620438+0000","last_undegraded":"2023-03-06T14:16:02.620438+0000","last_fullsized":"2023-03-06T14:16:02.620438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:38.013992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046786+0000","last_change":"2023-03-06T14:16:02.636774+0000","last_active":"2023-03-06T14:16:03.046786+0000","last_peered":"2023-03-06T14:16:03.046786+0000","last_clean":"2023-03-06T14:16:03.046786+0000","last_became_active":"2023-03-06T14:16:02.636419+0000","last_became_peered":"2023-03-06T14:16:02.636419+0000","last_unstale":"2023-03-06T14:16:03.046786+0000","last_undegraded":"2023-03-06T14:16:03.046786+0000","last_fullsized":"2023-03-06T14:16:03.046786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:11:50.112514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.636039+0000","last_change":"2023-03-06T14:15:58.193447+0000","last_active":"2023-03-06T14:16:02.636039+0000","last_peered":"2023-03-06T14:16:02.636039+0000","last_clean":"2023-03-06T14:16:02.636039+0000","last_became_active":"2023-03-06T14:15:58.193156+0000","last_became_peered":"2023-03-06T14:15:58.193156+0000","last_unstale":"2023-03-06T14:16:02.636039+0000","last_undegraded":"2023-03-06T14:16:02.636039+0000","last_fullsized":"2023-03-06T14:16:02.636039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:01:51.926759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631312+0000","last_change":"2023-03-06T14:15:58.631829+0000","last_active":"2023-03-06T14:16:02.631312+0000","last_peered":"2023-03-06T14:16:02.631312+0000","last_clean":"2023-03-06T14:16:02.631312+0000","last_became_active":"2023-03-06T14:15:58.631539+0000","last_became_peered":"2023-03-06T14:15:58.631539+0000","last_unstale":"2023-03-06T14:16:02.631312+0000","last_undegraded":"2023-03-06T14:16:02.631312+0000","last_fullsized":"2023-03-06T14:16:02.631312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:07:29.050347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.152775+0000","last_change":"2023-03-06T14:16:02.651029+0000","last_active":"2023-03-06T14:16:03.152775+0000","last_peered":"2023-03-06T14:16:03.152775+0000","last_clean":"2023-03-06T14:16:03.152775+0000","last_became_active":"2023-03-06T14:16:02.647451+0000","last_became_peered":"2023-03-06T14:16:02.647451+0000","last_unstale":"2023-03-06T14:16:03.152775+0000","last_undegraded":"2023-03-06T14:16:03.152775+0000","last_fullsized":"2023-03-06T14:16:03.152775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:42:32.218248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620790+0000","last_change":"2023-03-06T14:15:58.199612+0000","last_active":"2023-03-06T14:16:02.620790+0000","last_peered":"2023-03-06T14:16:02.620790+0000","last_clean":"2023-03-06T14:16:02.620790+0000","last_became_active":"2023-03-06T14:15:58.199287+0000","last_became_peered":"2023-03-06T14:15:58.199287+0000","last_unstale":"2023-03-06T14:16:02.620790+0000","last_undegraded":"2023-03-06T14:16:02.620790+0000","last_fullsized":"2023-03-06T14:16:02.620790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:01:51.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628754+0000","last_change":"2023-03-06T14:15:58.623084+0000","last_active":"2023-03-06T14:16:02.628754+0000","last_peered":"2023-03-06T14:16:02.628754+0000","last_clean":"2023-03-06T14:16:02.628754+0000","last_became_active":"2023-03-06T14:15:58.622619+0000","last_became_peered":"2023-03-06T14:15:58.622619+0000","last_unstale":"2023-03-06T14:16:02.628754+0000","last_undegraded":"2023-03-06T14:16:02.628754+0000","last_fullsized":"2023-03-06T14:16:02.628754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:55:43.155483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046240+0000","last_change":"2023-03-06T14:16:02.649807+0000","last_active":"2023-03-06T14:16:03.046240+0000","last_peered":"2023-03-06T14:16:03.046240+0000","last_clean":"2023-03-06T14:16:03.046240+0000","last_became_active":"2023-03-06T14:16:02.649413+0000","last_became_peered":"2023-03-06T14:16:02.649413+0000","last_unstale":"2023-03-06T14:16:03.046240+0000","last_undegraded":"2023-03-06T14:16:03.046240+0000","last_fullsized":"2023-03-06T14:16:03.046240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:21:53.710722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633850+0000","last_change":"2023-03-06T14:15:58.198905+0000","last_active":"2023-03-06T14:16:02.633850+0000","last_peered":"2023-03-06T14:16:02.633850+0000","last_clean":"2023-03-06T14:16:02.633850+0000","last_became_active":"2023-03-06T14:15:58.198283+0000","last_became_peered":"2023-03-06T14:15:58.198283+0000","last_unstale":"2023-03-06T14:16:02.633850+0000","last_undegraded":"2023-03-06T14:16:02.633850+0000","last_fullsized":"2023-03-06T14:16:02.633850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:51.640135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620677+0000","last_change":"2023-03-06T14:15:58.629610+0000","last_active":"2023-03-06T14:16:02.620677+0000","last_peered":"2023-03-06T14:16:02.620677+0000","last_clean":"2023-03-06T14:16:02.620677+0000","last_became_active":"2023-03-06T14:15:58.629363+0000","last_became_peered":"2023-03-06T14:15:58.629363+0000","last_unstale":"2023-03-06T14:16:02.620677+0000","last_undegraded":"2023-03-06T14:16:02.620677+0000","last_fullsized":"2023-03-06T14:16:02.620677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.354086+0000","last_change":"2023-03-06T14:16:02.648003+0000","last_active":"2023-03-06T14:16:03.354086+0000","last_peered":"2023-03-06T14:16:03.354086+0000","last_clean":"2023-03-06T14:16:03.354086+0000","last_became_active":"2023-03-06T14:16:02.647584+0000","last_became_peered":"2023-03-06T14:16:02.647584+0000","last_unstale":"2023-03-06T14:16:03.354086+0000","last_undegraded":"2023-03-06T14:16:03.354086+0000","last_fullsized":"2023-03-06T14:16:03.354086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:07:43.686453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622697+0000","last_change":"2023-03-06T14:15:58.196508+0000","last_active":"2023-03-06T14:16:02.622697+0000","last_peered":"2023-03-06T14:16:02.622697+0000","last_clean":"2023-03-06T14:16:02.622697+0000","last_became_active":"2023-03-06T14:15:58.196196+0000","last_became_peered":"2023-03-06T14:15:58.196196+0000","last_unstale":"2023-03-06T14:16:02.622697+0000","last_undegraded":"2023-03-06T14:16:02.622697+0000","last_fullsized":"2023-03-06T14:16:02.622697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:35.375050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620110+0000","last_change":"2023-03-06T14:15:58.630871+0000","last_active":"2023-03-06T14:16:02.620110+0000","last_peered":"2023-03-06T14:16:02.620110+0000","last_clean":"2023-03-06T14:16:02.620110+0000","last_became_active":"2023-03-06T14:15:58.630600+0000","last_became_peered":"2023-03-06T14:15:58.630600+0000","last_unstale":"2023-03-06T14:16:02.620110+0000","last_undegraded":"2023-03-06T14:16:02.620110+0000","last_fullsized":"2023-03-06T14:16:02.620110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:11:46.673965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046607+0000","last_change":"2023-03-06T14:16:02.647406+0000","last_active":"2023-03-06T14:16:03.046607+0000","last_peered":"2023-03-06T14:16:03.046607+0000","last_clean":"2023-03-06T14:16:03.046607+0000","last_became_active":"2023-03-06T14:16:02.646991+0000","last_became_peered":"2023-03-06T14:16:02.646991+0000","last_unstale":"2023-03-06T14:16:03.046607+0000","last_undegraded":"2023-03-06T14:16:03.046607+0000","last_fullsized":"2023-03-06T14:16:03.046607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:08:18.196610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631874+0000","last_change":"2023-03-06T14:15:58.203832+0000","last_active":"2023-03-06T14:16:02.631874+0000","last_peered":"2023-03-06T14:16:02.631874+0000","last_clean":"2023-03-06T14:16:02.631874+0000","last_became_active":"2023-03-06T14:15:58.202151+0000","last_became_peered":"2023-03-06T14:15:58.202151+0000","last_unstale":"2023-03-06T14:16:02.631874+0000","last_undegraded":"2023-03-06T14:16:02.631874+0000","last_fullsized":"2023-03-06T14:16:02.631874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:48:04.338436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637281+0000","last_change":"2023-03-06T14:15:58.623887+0000","last_active":"2023-03-06T14:16:02.637281+0000","last_peered":"2023-03-06T14:16:02.637281+0000","last_clean":"2023-03-06T14:16:02.637281+0000","last_became_active":"2023-03-06T14:15:58.623588+0000","last_became_peered":"2023-03-06T14:15:58.623588+0000","last_unstale":"2023-03-06T14:16:02.637281+0000","last_undegraded":"2023-03-06T14:16:02.637281+0000","last_fullsized":"2023-03-06T14:16:02.637281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:07:29.725804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.154947+0000","last_change":"2023-03-06T14:16:02.640486+0000","last_active":"2023-03-06T14:16:03.154947+0000","last_peered":"2023-03-06T14:16:03.154947+0000","last_clean":"2023-03-06T14:16:03.154947+0000","last_became_active":"2023-03-06T14:16:02.640118+0000","last_became_peered":"2023-03-06T14:16:02.640118+0000","last_unstale":"2023-03-06T14:16:03.154947+0000","last_undegraded":"2023-03-06T14:16:03.154947+0000","last_fullsized":"2023-03-06T14:16:03.154947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:27:58.703596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:14.065253+0000","last_change":"2023-03-06T14:15:58.192763+0000","last_active":"2023-03-06T14:16:14.065253+0000","last_peered":"2023-03-06T14:16:14.065253+0000","last_clean":"2023-03-06T14:16:14.065253+0000","last_became_active":"2023-03-06T14:15:58.192461+0000","last_became_peered":"2023-03-06T14:15:58.192461+0000","last_unstale":"2023-03-06T14:16:14.065253+0000","last_undegraded":"2023-03-06T14:16:14.065253+0000","last_fullsized":"2023-03-06T14:16:14.065253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:29:15.572837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3746,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623479+0000","last_change":"2023-03-06T14:15:58.617934+0000","last_active":"2023-03-06T14:16:02.623479+0000","last_peered":"2023-03-06T14:16:02.623479+0000","last_clean":"2023-03-06T14:16:02.623479+0000","last_became_active":"2023-03-06T14:15:58.617387+0000","last_became_peered":"2023-03-06T14:15:58.617387+0000","last_unstale":"2023-03-06T14:16:02.623479+0000","last_undegraded":"2023-03-06T14:16:02.623479+0000","last_fullsized":"2023-03-06T14:16:02.623479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:18:06.098146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045480+0000","last_change":"2023-03-06T14:16:02.648850+0000","last_active":"2023-03-06T14:16:03.045480+0000","last_peered":"2023-03-06T14:16:03.045480+0000","last_clean":"2023-03-06T14:16:03.045480+0000","last_became_active":"2023-03-06T14:16:02.648464+0000","last_became_peered":"2023-03-06T14:16:02.648464+0000","last_unstale":"2023-03-06T14:16:03.045480+0000","last_undegraded":"2023-03-06T14:16:03.045480+0000","last_fullsized":"2023-03-06T14:16:03.045480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:36:04.845196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631439+0000","last_change":"2023-03-06T14:15:58.196704+0000","last_active":"2023-03-06T14:16:02.631439+0000","last_peered":"2023-03-06T14:16:02.631439+0000","last_clean":"2023-03-06T14:16:02.631439+0000","last_became_active":"2023-03-06T14:15:58.196420+0000","last_became_peered":"2023-03-06T14:15:58.196420+0000","last_unstale":"2023-03-06T14:16:02.631439+0000","last_undegraded":"2023-03-06T14:16:02.631439+0000","last_fullsized":"2023-03-06T14:16:02.631439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:30:50.230310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620609+0000","last_change":"2023-03-06T14:15:58.624384+0000","last_active":"2023-03-06T14:16:02.620609+0000","last_peered":"2023-03-06T14:16:02.620609+0000","last_clean":"2023-03-06T14:16:02.620609+0000","last_became_active":"2023-03-06T14:15:58.624104+0000","last_became_peered":"2023-03-06T14:15:58.624104+0000","last_unstale":"2023-03-06T14:16:02.620609+0000","last_undegraded":"2023-03-06T14:16:02.620609+0000","last_fullsized":"2023-03-06T14:16:02.620609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046476+0000","last_change":"2023-03-06T14:16:02.649893+0000","last_active":"2023-03-06T14:16:03.046476+0000","last_peered":"2023-03-06T14:16:03.046476+0000","last_clean":"2023-03-06T14:16:03.046476+0000","last_became_active":"2023-03-06T14:16:02.649449+0000","last_became_peered":"2023-03-06T14:16:02.649449+0000","last_unstale":"2023-03-06T14:16:03.046476+0000","last_undegraded":"2023-03-06T14:16:03.046476+0000","last_fullsized":"2023-03-06T14:16:03.046476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:16:47.318848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.626428+0000","last_change":"2023-03-06T14:15:58.199816+0000","last_active":"2023-03-06T14:16:02.626428+0000","last_peered":"2023-03-06T14:16:02.626428+0000","last_clean":"2023-03-06T14:16:02.626428+0000","last_became_active":"2023-03-06T14:15:58.198949+0000","last_became_peered":"2023-03-06T14:15:58.198949+0000","last_unstale":"2023-03-06T14:16:02.626428+0000","last_undegraded":"2023-03-06T14:16:02.626428+0000","last_fullsized":"2023-03-06T14:16:02.626428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:38:41.806931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623461+0000","last_change":"2023-03-06T14:15:58.630195+0000","last_active":"2023-03-06T14:16:02.623461+0000","last_peered":"2023-03-06T14:16:02.623461+0000","last_clean":"2023-03-06T14:16:02.623461+0000","last_became_active":"2023-03-06T14:15:58.629926+0000","last_became_peered":"2023-03-06T14:15:58.629926+0000","last_unstale":"2023-03-06T14:16:02.623461+0000","last_undegraded":"2023-03-06T14:16:02.623461+0000","last_fullsized":"2023-03-06T14:16:02.623461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046473+0000","last_change":"2023-03-06T14:16:02.650159+0000","last_active":"2023-03-06T14:16:03.046473+0000","last_peered":"2023-03-06T14:16:03.046473+0000","last_clean":"2023-03-06T14:16:03.046473+0000","last_became_active":"2023-03-06T14:16:02.649734+0000","last_became_peered":"2023-03-06T14:16:02.649734+0000","last_unstale":"2023-03-06T14:16:03.046473+0000","last_undegraded":"2023-03-06T14:16:03.046473+0000","last_fullsized":"2023-03-06T14:16:03.046473+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:12:39.833476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633836+0000","last_change":"2023-03-06T14:15:58.197641+0000","last_active":"2023-03-06T14:16:02.633836+0000","last_peered":"2023-03-06T14:16:02.633836+0000","last_clean":"2023-03-06T14:16:02.633836+0000","last_became_active":"2023-03-06T14:15:58.197332+0000","last_became_peered":"2023-03-06T14:15:58.197332+0000","last_unstale":"2023-03-06T14:16:02.633836+0000","last_undegraded":"2023-03-06T14:16:02.633836+0000","last_fullsized":"2023-03-06T14:16:02.633836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:42:02.415337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631395+0000","last_change":"2023-03-06T14:15:58.619271+0000","last_active":"2023-03-06T14:16:02.631395+0000","last_peered":"2023-03-06T14:16:02.631395+0000","last_clean":"2023-03-06T14:16:02.631395+0000","last_became_active":"2023-03-06T14:15:58.618980+0000","last_became_peered":"2023-03-06T14:15:58.618980+0000","last_unstale":"2023-03-06T14:16:02.631395+0000","last_undegraded":"2023-03-06T14:16:02.631395+0000","last_fullsized":"2023-03-06T14:16:02.631395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045038+0000","last_change":"2023-03-06T14:16:02.641990+0000","last_active":"2023-03-06T14:16:03.045038+0000","last_peered":"2023-03-06T14:16:03.045038+0000","last_clean":"2023-03-06T14:16:03.045038+0000","last_became_active":"2023-03-06T14:16:02.641619+0000","last_became_peered":"2023-03-06T14:16:02.641619+0000","last_unstale":"2023-03-06T14:16:03.045038+0000","last_undegraded":"2023-03-06T14:16:03.045038+0000","last_fullsized":"2023-03-06T14:16:03.045038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:07:17.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628320+0000","last_change":"2023-03-06T14:15:58.199278+0000","last_active":"2023-03-06T14:16:02.628320+0000","last_peered":"2023-03-06T14:16:02.628320+0000","last_clean":"2023-03-06T14:16:02.628320+0000","last_became_active":"2023-03-06T14:15:58.198946+0000","last_became_peered":"2023-03-06T14:15:58.198946+0000","last_unstale":"2023-03-06T14:16:02.628320+0000","last_undegraded":"2023-03-06T14:16:02.628320+0000","last_fullsized":"2023-03-06T14:16:02.628320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:56:39.417304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621143+0000","last_change":"2023-03-06T14:15:58.630272+0000","last_active":"2023-03-06T14:16:02.621143+0000","last_peered":"2023-03-06T14:16:02.621143+0000","last_clean":"2023-03-06T14:16:02.621143+0000","last_became_active":"2023-03-06T14:15:58.630009+0000","last_became_peered":"2023-03-06T14:15:58.630009+0000","last_unstale":"2023-03-06T14:16:02.621143+0000","last_undegraded":"2023-03-06T14:16:02.621143+0000","last_fullsized":"2023-03-06T14:16:02.621143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:11:35.054920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.355117+0000","last_change":"2023-03-06T14:16:02.640631+0000","last_active":"2023-03-06T14:16:03.355117+0000","last_peered":"2023-03-06T14:16:03.355117+0000","last_clean":"2023-03-06T14:16:03.355117+0000","last_became_active":"2023-03-06T14:16:02.640221+0000","last_became_peered":"2023-03-06T14:16:02.640221+0000","last_unstale":"2023-03-06T14:16:03.355117+0000","last_undegraded":"2023-03-06T14:16:03.355117+0000","last_fullsized":"2023-03-06T14:16:03.355117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:27:58.703596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.632795+0000","last_change":"2023-03-06T14:15:58.198789+0000","last_active":"2023-03-06T14:16:02.632795+0000","last_peered":"2023-03-06T14:16:02.632795+0000","last_clean":"2023-03-06T14:16:02.632795+0000","last_became_active":"2023-03-06T14:15:58.197338+0000","last_became_peered":"2023-03-06T14:15:58.197338+0000","last_unstale":"2023-03-06T14:16:02.632795+0000","last_undegraded":"2023-03-06T14:16:02.632795+0000","last_fullsized":"2023-03-06T14:16:02.632795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:55:42.146253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620931+0000","last_change":"2023-03-06T14:15:58.626518+0000","last_active":"2023-03-06T14:16:02.620931+0000","last_peered":"2023-03-06T14:16:02.620931+0000","last_clean":"2023-03-06T14:16:02.620931+0000","last_became_active":"2023-03-06T14:15:58.626233+0000","last_became_peered":"2023-03-06T14:15:58.626233+0000","last_unstale":"2023-03-06T14:16:02.620931+0000","last_undegraded":"2023-03-06T14:16:02.620931+0000","last_fullsized":"2023-03-06T14:16:02.620931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:52:46.916668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291216+0000","last_change":"2023-03-06T14:16:02.650940+0000","last_active":"2023-03-06T14:16:03.291216+0000","last_peered":"2023-03-06T14:16:03.291216+0000","last_clean":"2023-03-06T14:16:03.291216+0000","last_became_active":"2023-03-06T14:16:02.650036+0000","last_became_peered":"2023-03-06T14:16:02.650036+0000","last_unstale":"2023-03-06T14:16:03.291216+0000","last_undegraded":"2023-03-06T14:16:03.291216+0000","last_fullsized":"2023-03-06T14:16:03.291216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:24:02.015602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631826+0000","last_change":"2023-03-06T14:15:58.197042+0000","last_active":"2023-03-06T14:16:02.631826+0000","last_peered":"2023-03-06T14:16:02.631826+0000","last_clean":"2023-03-06T14:16:02.631826+0000","last_became_active":"2023-03-06T14:15:58.196755+0000","last_became_peered":"2023-03-06T14:15:58.196755+0000","last_unstale":"2023-03-06T14:16:02.631826+0000","last_undegraded":"2023-03-06T14:16:02.631826+0000","last_fullsized":"2023-03-06T14:16:02.631826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:05.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622215+0000","last_change":"2023-03-06T14:15:58.624665+0000","last_active":"2023-03-06T14:16:02.622215+0000","last_peered":"2023-03-06T14:16:02.622215+0000","last_clean":"2023-03-06T14:16:02.622215+0000","last_became_active":"2023-03-06T14:15:58.624294+0000","last_became_peered":"2023-03-06T14:15:58.624294+0000","last_unstale":"2023-03-06T14:16:02.622215+0000","last_undegraded":"2023-03-06T14:16:02.622215+0000","last_fullsized":"2023-03-06T14:16:02.622215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:20:31.540353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291400+0000","last_change":"2023-03-06T14:16:02.652542+0000","last_active":"2023-03-06T14:16:03.291400+0000","last_peered":"2023-03-06T14:16:03.291400+0000","last_clean":"2023-03-06T14:16:03.291400+0000","last_became_active":"2023-03-06T14:16:02.652083+0000","last_became_peered":"2023-03-06T14:16:02.652083+0000","last_unstale":"2023-03-06T14:16:03.291400+0000","last_undegraded":"2023-03-06T14:16:03.291400+0000","last_fullsized":"2023-03-06T14:16:03.291400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:18:11.159923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.632018+0000","last_change":"2023-03-06T14:15:58.198266+0000","last_active":"2023-03-06T14:16:02.632018+0000","last_peered":"2023-03-06T14:16:02.632018+0000","last_clean":"2023-03-06T14:16:02.632018+0000","last_became_active":"2023-03-06T14:15:58.197982+0000","last_became_peered":"2023-03-06T14:15:58.197982+0000","last_unstale":"2023-03-06T14:16:02.632018+0000","last_undegraded":"2023-03-06T14:16:02.632018+0000","last_fullsized":"2023-03-06T14:16:02.632018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:35.375050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.627709+0000","last_change":"2023-03-06T14:15:58.626386+0000","last_active":"2023-03-06T14:16:02.627709+0000","last_peered":"2023-03-06T14:16:02.627709+0000","last_clean":"2023-03-06T14:16:02.627709+0000","last_became_active":"2023-03-06T14:15:58.626081+0000","last_became_peered":"2023-03-06T14:15:58.626081+0000","last_unstale":"2023-03-06T14:16:02.627709+0000","last_undegraded":"2023-03-06T14:16:02.627709+0000","last_fullsized":"2023-03-06T14:16:02.627709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:06.411673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291518+0000","last_change":"2023-03-06T14:16:02.645559+0000","last_active":"2023-03-06T14:16:03.291518+0000","last_peered":"2023-03-06T14:16:03.291518+0000","last_clean":"2023-03-06T14:16:03.291518+0000","last_became_active":"2023-03-06T14:16:02.645162+0000","last_became_peered":"2023-03-06T14:16:02.645162+0000","last_unstale":"2023-03-06T14:16:03.291518+0000","last_undegraded":"2023-03-06T14:16:03.291518+0000","last_fullsized":"2023-03-06T14:16:03.291518+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:41.452541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621160+0000","last_change":"2023-03-06T14:15:58.201356+0000","last_active":"2023-03-06T14:16:02.621160+0000","last_peered":"2023-03-06T14:16:02.621160+0000","last_clean":"2023-03-06T14:16:02.621160+0000","last_became_active":"2023-03-06T14:15:58.201039+0000","last_became_peered":"2023-03-06T14:15:58.201039+0000","last_unstale":"2023-03-06T14:16:02.621160+0000","last_undegraded":"2023-03-06T14:16:02.621160+0000","last_fullsized":"2023-03-06T14:16:02.621160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:30:50.230310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637140+0000","last_change":"2023-03-06T14:15:58.626686+0000","last_active":"2023-03-06T14:16:02.637140+0000","last_peered":"2023-03-06T14:16:02.637140+0000","last_clean":"2023-03-06T14:16:02.637140+0000","last_became_active":"2023-03-06T14:15:58.626389+0000","last_became_peered":"2023-03-06T14:15:58.626389+0000","last_unstale":"2023-03-06T14:16:02.637140+0000","last_undegraded":"2023-03-06T14:16:02.637140+0000","last_fullsized":"2023-03-06T14:16:02.637140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:20:31.540353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291620+0000","last_change":"2023-03-06T14:16:02.642347+0000","last_active":"2023-03-06T14:16:03.291620+0000","last_peered":"2023-03-06T14:16:03.291620+0000","last_clean":"2023-03-06T14:16:03.291620+0000","last_became_active":"2023-03-06T14:16:02.641731+0000","last_became_peered":"2023-03-06T14:16:02.641731+0000","last_unstale":"2023-03-06T14:16:03.291620+0000","last_undegraded":"2023-03-06T14:16:03.291620+0000","last_fullsized":"2023-03-06T14:16:03.291620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:44:38.354278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620347+0000","last_change":"2023-03-06T14:15:58.203350+0000","last_active":"2023-03-06T14:16:02.620347+0000","last_peered":"2023-03-06T14:16:02.620347+0000","last_clean":"2023-03-06T14:16:02.620347+0000","last_became_active":"2023-03-06T14:15:58.203061+0000","last_became_peered":"2023-03-06T14:15:58.203061+0000","last_unstale":"2023-03-06T14:16:02.620347+0000","last_undegraded":"2023-03-06T14:16:02.620347+0000","last_fullsized":"2023-03-06T14:16:02.620347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:51.640135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623485+0000","last_change":"2023-03-06T14:15:58.622192+0000","last_active":"2023-03-06T14:16:02.623485+0000","last_peered":"2023-03-06T14:16:02.623485+0000","last_clean":"2023-03-06T14:16:02.623485+0000","last_became_active":"2023-03-06T14:15:58.621902+0000","last_became_peered":"2023-03-06T14:15:58.621902+0000","last_unstale":"2023-03-06T14:16:02.623485+0000","last_undegraded":"2023-03-06T14:16:02.623485+0000","last_fullsized":"2023-03-06T14:16:02.623485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:44:34.915729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.155015+0000","last_change":"2023-03-06T14:16:02.646555+0000","last_active":"2023-03-06T14:16:03.155015+0000","last_peered":"2023-03-06T14:16:03.155015+0000","last_clean":"2023-03-06T14:16:03.155015+0000","last_became_active":"2023-03-06T14:16:02.646107+0000","last_became_peered":"2023-03-06T14:16:02.646107+0000","last_unstale":"2023-03-06T14:16:03.155015+0000","last_undegraded":"2023-03-06T14:16:03.155015+0000","last_fullsized":"2023-03-06T14:16:03.155015+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:07:43.686453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.627804+0000","last_change":"2023-03-06T14:15:58.190228+0000","last_active":"2023-03-06T14:16:02.627804+0000","last_peered":"2023-03-06T14:16:02.627804+0000","last_clean":"2023-03-06T14:16:02.627804+0000","last_became_active":"2023-03-06T14:15:58.189952+0000","last_became_peered":"2023-03-06T14:15:58.189952+0000","last_unstale":"2023-03-06T14:16:02.627804+0000","last_undegraded":"2023-03-06T14:16:02.627804+0000","last_fullsized":"2023-03-06T14:16:02.627804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:29:15.572837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.624802+0000","last_change":"2023-03-06T14:15:58.618284+0000","last_active":"2023-03-06T14:16:02.624802+0000","last_peered":"2023-03-06T14:16:02.624802+0000","last_clean":"2023-03-06T14:16:02.624802+0000","last_became_active":"2023-03-06T14:15:58.617886+0000","last_became_peered":"2023-03-06T14:15:58.617886+0000","last_unstale":"2023-03-06T14:16:02.624802+0000","last_undegraded":"2023-03-06T14:16:02.624802+0000","last_fullsized":"2023-03-06T14:16:02.624802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:10:40.167591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045610+0000","last_change":"2023-03-06T14:16:02.647040+0000","last_active":"2023-03-06T14:16:03.045610+0000","last_peered":"2023-03-06T14:16:03.045610+0000","last_clean":"2023-03-06T14:16:03.045610+0000","last_became_active":"2023-03-06T14:16:02.645423+0000","last_became_peered":"2023-03-06T14:16:02.645423+0000","last_unstale":"2023-03-06T14:16:03.045610+0000","last_undegraded":"2023-03-06T14:16:03.045610+0000","last_fullsized":"2023-03-06T14:16:03.045610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:13:57.742131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622031+0000","last_change":"2023-03-06T14:15:58.197730+0000","last_active":"2023-03-06T14:16:02.622031+0000","last_peered":"2023-03-06T14:16:02.622031+0000","last_clean":"2023-03-06T14:16:02.622031+0000","last_became_active":"2023-03-06T14:15:58.197400+0000","last_became_peered":"2023-03-06T14:15:58.197400+0000","last_unstale":"2023-03-06T14:16:02.622031+0000","last_undegraded":"2023-03-06T14:16:02.622031+0000","last_fullsized":"2023-03-06T14:16:02.622031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:56:39.417304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.625017+0000","last_change":"2023-03-06T14:15:58.615181+0000","last_active":"2023-03-06T14:16:02.625017+0000","last_peered":"2023-03-06T14:16:02.625017+0000","last_clean":"2023-03-06T14:16:02.625017+0000","last_became_active":"2023-03-06T14:15:58.614850+0000","last_became_peered":"2023-03-06T14:15:58.614850+0000","last_unstale":"2023-03-06T14:16:02.625017+0000","last_undegraded":"2023-03-06T14:16:02.625017+0000","last_fullsized":"2023-03-06T14:16:02.625017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.354671+0000","last_change":"2023-03-06T14:16:02.646047+0000","last_active":"2023-03-06T14:16:03.354671+0000","last_peered":"2023-03-06T14:16:03.354671+0000","last_clean":"2023-03-06T14:16:03.354671+0000","last_became_active":"2023-03-06T14:16:02.645633+0000","last_became_peered":"2023-03-06T14:16:02.645633+0000","last_unstale":"2023-03-06T14:16:03.354671+0000","last_undegraded":"2023-03-06T14:16:03.354671+0000","last_fullsized":"2023-03-06T14:16:03.354671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:50:22.369914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620211+0000","last_change":"2023-03-06T14:15:58.203072+0000","last_active":"2023-03-06T14:16:02.620211+0000","last_peered":"2023-03-06T14:16:02.620211+0000","last_clean":"2023-03-06T14:16:02.620211+0000","last_became_active":"2023-03-06T14:15:58.202762+0000","last_became_peered":"2023-03-06T14:15:58.202762+0000","last_unstale":"2023-03-06T14:16:02.620211+0000","last_undegraded":"2023-03-06T14:16:02.620211+0000","last_fullsized":"2023-03-06T14:16:02.620211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:01:51.926759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637882+0000","last_change":"2023-03-06T14:15:58.624080+0000","last_active":"2023-03-06T14:16:02.637882+0000","last_peered":"2023-03-06T14:16:02.637882+0000","last_clean":"2023-03-06T14:16:02.637882+0000","last_became_active":"2023-03-06T14:15:58.623721+0000","last_became_peered":"2023-03-06T14:15:58.623721+0000","last_unstale":"2023-03-06T14:16:02.637882+0000","last_undegraded":"2023-03-06T14:16:02.637882+0000","last_fullsized":"2023-03-06T14:16:02.637882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:52:46.916668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.152408+0000","last_change":"2023-03-06T14:16:02.653426+0000","last_active":"2023-03-06T14:16:03.152408+0000","last_peered":"2023-03-06T14:16:03.152408+0000","last_clean":"2023-03-06T14:16:03.152408+0000","last_became_active":"2023-03-06T14:16:02.653013+0000","last_became_peered":"2023-03-06T14:16:02.653013+0000","last_unstale":"2023-03-06T14:16:03.152408+0000","last_undegraded":"2023-03-06T14:16:03.152408+0000","last_fullsized":"2023-03-06T14:16:03.152408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:07:43.686453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637353+0000","last_change":"2023-03-06T14:15:53.577710+0000","last_active":"2023-03-06T14:16:02.637353+0000","last_peered":"2023-03-06T14:16:02.637353+0000","last_clean":"2023-03-06T14:16:02.637353+0000","last_became_active":"2023-03-06T14:15:53.577390+0000","last_became_peered":"2023-03-06T14:15:53.577390+0000","last_unstale":"2023-03-06T14:16:02.637353+0000","last_undegraded":"2023-03-06T14:16:02.637353+0000","last_fullsized":"2023-03-06T14:16:02.637353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:59:36.846415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623367+0000","last_change":"2023-03-06T14:15:58.201310+0000","last_active":"2023-03-06T14:16:02.623367+0000","last_peered":"2023-03-06T14:16:02.623367+0000","last_clean":"2023-03-06T14:16:02.623367+0000","last_became_active":"2023-03-06T14:15:58.200984+0000","last_became_peered":"2023-03-06T14:15:58.200984+0000","last_unstale":"2023-03-06T14:16:02.623367+0000","last_undegraded":"2023-03-06T14:16:02.623367+0000","last_fullsized":"2023-03-06T14:16:02.623367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:01:51.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637200+0000","last_change":"2023-03-06T14:15:58.624165+0000","last_active":"2023-03-06T14:16:02.637200+0000","last_peered":"2023-03-06T14:16:02.637200+0000","last_clean":"2023-03-06T14:16:02.637200+0000","last_became_active":"2023-03-06T14:15:58.623385+0000","last_became_peered":"2023-03-06T14:15:58.623385+0000","last_unstale":"2023-03-06T14:16:02.637200+0000","last_undegraded":"2023-03-06T14:16:02.637200+0000","last_fullsized":"2023-03-06T14:16:02.637200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:48:05.347666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.152390+0000","last_change":"2023-03-06T14:16:02.648398+0000","last_active":"2023-03-06T14:16:03.152390+0000","last_peered":"2023-03-06T14:16:03.152390+0000","last_clean":"2023-03-06T14:16:03.152390+0000","last_became_active":"2023-03-06T14:16:02.647065+0000","last_became_peered":"2023-03-06T14:16:02.647065+0000","last_unstale":"2023-03-06T14:16:03.152390+0000","last_undegraded":"2023-03-06T14:16:03.152390+0000","last_fullsized":"2023-03-06T14:16:03.152390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:07:17.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620733+0000","last_change":"2023-03-06T14:15:53.036374+0000","last_active":"2023-03-06T14:16:02.620733+0000","last_peered":"2023-03-06T14:16:02.620733+0000","last_clean":"2023-03-06T14:16:02.620733+0000","last_became_active":"2023-03-06T14:15:53.036038+0000","last_became_peered":"2023-03-06T14:15:53.036038+0000","last_unstale":"2023-03-06T14:16:02.620733+0000","last_undegraded":"2023-03-06T14:16:02.620733+0000","last_fullsized":"2023-03-06T14:16:02.620733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:59:36.846415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623310+0000","last_change":"2023-03-06T14:15:58.205953+0000","last_active":"2023-03-06T14:16:02.623310+0000","last_peered":"2023-03-06T14:16:02.623310+0000","last_clean":"2023-03-06T14:16:02.623310+0000","last_became_active":"2023-03-06T14:15:58.205660+0000","last_became_peered":"2023-03-06T14:15:58.205660+0000","last_unstale":"2023-03-06T14:16:02.623310+0000","last_undegraded":"2023-03-06T14:16:02.623310+0000","last_fullsized":"2023-03-06T14:16:02.623310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:01:51.926759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637265+0000","last_change":"2023-03-06T14:15:58.623348+0000","last_active":"2023-03-06T14:16:02.637265+0000","last_peered":"2023-03-06T14:16:02.637265+0000","last_clean":"2023-03-06T14:16:02.637265+0000","last_became_active":"2023-03-06T14:15:58.622915+0000","last_became_peered":"2023-03-06T14:15:58.622915+0000","last_unstale":"2023-03-06T14:16:02.637265+0000","last_undegraded":"2023-03-06T14:16:02.637265+0000","last_fullsized":"2023-03-06T14:16:02.637265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291678+0000","last_change":"2023-03-06T14:16:02.651042+0000","last_active":"2023-03-06T14:16:03.291678+0000","last_peered":"2023-03-06T14:16:03.291678+0000","last_clean":"2023-03-06T14:16:03.291678+0000","last_became_active":"2023-03-06T14:16:02.650162+0000","last_became_peered":"2023-03-06T14:16:02.650162+0000","last_unstale":"2023-03-06T14:16:03.291678+0000","last_undegraded":"2023-03-06T14:16:03.291678+0000","last_fullsized":"2023-03-06T14:16:03.291678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:37:28.905994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.634164+0000","last_change":"2023-03-06T14:15:53.036522+0000","last_active":"2023-03-06T14:16:02.634164+0000","last_peered":"2023-03-06T14:16:02.634164+0000","last_clean":"2023-03-06T14:16:02.634164+0000","last_became_active":"2023-03-06T14:15:53.036163+0000","last_became_peered":"2023-03-06T14:15:53.036163+0000","last_unstale":"2023-03-06T14:16:02.634164+0000","last_undegraded":"2023-03-06T14:16:02.634164+0000","last_fullsized":"2023-03-06T14:16:02.634164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:27:14.056008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.635952+0000","last_change":"2023-03-06T14:15:58.197803+0000","last_active":"2023-03-06T14:16:02.635952+0000","last_peered":"2023-03-06T14:16:02.635952+0000","last_clean":"2023-03-06T14:16:02.635952+0000","last_became_active":"2023-03-06T14:15:58.197545+0000","last_became_peered":"2023-03-06T14:15:58.197545+0000","last_unstale":"2023-03-06T14:16:02.635952+0000","last_undegraded":"2023-03-06T14:16:02.635952+0000","last_fullsized":"2023-03-06T14:16:02.635952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:12:34.886024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637845+0000","last_change":"2023-03-06T14:15:58.623911+0000","last_active":"2023-03-06T14:16:02.637845+0000","last_peered":"2023-03-06T14:16:02.637845+0000","last_clean":"2023-03-06T14:16:02.637845+0000","last_became_active":"2023-03-06T14:15:58.623425+0000","last_became_peered":"2023-03-06T14:15:58.623425+0000","last_unstale":"2023-03-06T14:16:02.637845+0000","last_undegraded":"2023-03-06T14:16:02.637845+0000","last_fullsized":"2023-03-06T14:16:02.637845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:25:29.813558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.355462+0000","last_change":"2023-03-06T14:16:02.651414+0000","last_active":"2023-03-06T14:16:03.355462+0000","last_peered":"2023-03-06T14:16:03.355462+0000","last_clean":"2023-03-06T14:16:03.355462+0000","last_became_active":"2023-03-06T14:16:02.650987+0000","last_became_peered":"2023-03-06T14:16:02.650987+0000","last_unstale":"2023-03-06T14:16:03.355462+0000","last_undegraded":"2023-03-06T14:16:03.355462+0000","last_fullsized":"2023-03-06T14:16:03.355462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:07:17.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621937+0000","last_change":"2023-03-06T14:15:53.036219+0000","last_active":"2023-03-06T14:16:02.621937+0000","last_peered":"2023-03-06T14:16:02.621937+0000","last_clean":"2023-03-06T14:16:02.621937+0000","last_became_active":"2023-03-06T14:15:53.035884+0000","last_became_peered":"2023-03-06T14:15:53.035884+0000","last_unstale":"2023-03-06T14:16:02.621937+0000","last_undegraded":"2023-03-06T14:16:02.621937+0000","last_fullsized":"2023-03-06T14:16:02.621937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:08:35.979345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":171,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.630995+0000","last_change":"2023-03-06T14:15:46.468596+0000","last_active":"2023-03-06T14:16:02.630995+0000","last_peered":"2023-03-06T14:16:02.630995+0000","last_clean":"2023-03-06T14:16:02.630995+0000","last_became_active":"2023-03-06T14:15:46.467792+0000","last_became_peered":"2023-03-06T14:15:46.467792+0000","last_unstale":"2023-03-06T14:16:02.630995+0000","last_undegraded":"2023-03-06T14:16:02.630995+0000","last_fullsized":"2023-03-06T14:16:02.630995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:45.376343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:45.376343+0000","last_clean_scrub_stamp":"2023-03-06T14:15:45.376343+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:52:08.690494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620179+0000","last_change":"2023-03-06T14:15:58.193624+0000","last_active":"2023-03-06T14:16:02.620179+0000","last_peered":"2023-03-06T14:16:02.620179+0000","last_clean":"2023-03-06T14:16:02.620179+0000","last_became_active":"2023-03-06T14:15:58.192670+0000","last_became_peered":"2023-03-06T14:15:58.192670+0000","last_unstale":"2023-03-06T14:16:02.620179+0000","last_undegraded":"2023-03-06T14:16:02.620179+0000","last_fullsized":"2023-03-06T14:16:02.620179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:56:39.417304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628029+0000","last_change":"2023-03-06T14:15:58.621410+0000","last_active":"2023-03-06T14:16:02.628029+0000","last_peered":"2023-03-06T14:16:02.628029+0000","last_clean":"2023-03-06T14:16:02.628029+0000","last_became_active":"2023-03-06T14:15:58.621119+0000","last_became_peered":"2023-03-06T14:15:58.621119+0000","last_unstale":"2023-03-06T14:16:02.628029+0000","last_undegraded":"2023-03-06T14:16:02.628029+0000","last_fullsized":"2023-03-06T14:16:02.628029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:07:29.725804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045514+0000","last_change":"2023-03-06T14:16:02.647842+0000","last_active":"2023-03-06T14:16:03.045514+0000","last_peered":"2023-03-06T14:16:03.045514+0000","last_clean":"2023-03-06T14:16:03.045514+0000","last_became_active":"2023-03-06T14:16:02.647453+0000","last_became_peered":"2023-03-06T14:16:02.647453+0000","last_unstale":"2023-03-06T14:16:03.045514+0000","last_undegraded":"2023-03-06T14:16:03.045514+0000","last_fullsized":"2023-03-06T14:16:03.045514+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:16:47.318848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631088+0000","last_change":"2023-03-06T14:15:53.037318+0000","last_active":"2023-03-06T14:16:02.631088+0000","last_peered":"2023-03-06T14:16:02.631088+0000","last_clean":"2023-03-06T14:16:02.631088+0000","last_became_active":"2023-03-06T14:15:53.036984+0000","last_became_peered":"2023-03-06T14:15:53.036984+0000","last_unstale":"2023-03-06T14:16:02.631088+0000","last_undegraded":"2023-03-06T14:16:02.631088+0000","last_fullsized":"2023-03-06T14:16:02.631088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:59:36.846415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633034+0000","last_change":"2023-03-06T14:15:58.203061+0000","last_active":"2023-03-06T14:16:02.633034+0000","last_peered":"2023-03-06T14:16:02.633034+0000","last_clean":"2023-03-06T14:16:02.633034+0000","last_became_active":"2023-03-06T14:15:58.202734+0000","last_became_peered":"2023-03-06T14:15:58.202734+0000","last_unstale":"2023-03-06T14:16:02.633034+0000","last_undegraded":"2023-03-06T14:16:02.633034+0000","last_fullsized":"2023-03-06T14:16:02.633034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:56:39.417304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631131+0000","last_change":"2023-03-06T14:15:58.628462+0000","last_active":"2023-03-06T14:16:02.631131+0000","last_peered":"2023-03-06T14:16:02.631131+0000","last_clean":"2023-03-06T14:16:02.631131+0000","last_became_active":"2023-03-06T14:15:58.628169+0000","last_became_peered":"2023-03-06T14:15:58.628169+0000","last_unstale":"2023-03-06T14:16:02.631131+0000","last_undegraded":"2023-03-06T14:16:02.631131+0000","last_fullsized":"2023-03-06T14:16:02.631131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:11:35.054920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046549+0000","last_change":"2023-03-06T14:16:02.651316+0000","last_active":"2023-03-06T14:16:03.046549+0000","last_peered":"2023-03-06T14:16:03.046549+0000","last_clean":"2023-03-06T14:16:03.046549+0000","last_became_active":"2023-03-06T14:16:02.650952+0000","last_became_peered":"2023-03-06T14:16:02.650952+0000","last_unstale":"2023-03-06T14:16:03.046549+0000","last_undegraded":"2023-03-06T14:16:03.046549+0000","last_fullsized":"2023-03-06T14:16:03.046549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:10:43.606141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631980+0000","last_change":"2023-03-06T14:15:53.577586+0000","last_active":"2023-03-06T14:16:02.631980+0000","last_peered":"2023-03-06T14:16:02.631980+0000","last_clean":"2023-03-06T14:16:02.631980+0000","last_became_active":"2023-03-06T14:15:53.577345+0000","last_became_peered":"2023-03-06T14:15:53.577345+0000","last_unstale":"2023-03-06T14:16:02.631980+0000","last_undegraded":"2023-03-06T14:16:02.631980+0000","last_fullsized":"2023-03-06T14:16:02.631980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:08:35.979345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637442+0000","last_change":"2023-03-06T14:15:58.199583+0000","last_active":"2023-03-06T14:16:02.637442+0000","last_peered":"2023-03-06T14:16:02.637442+0000","last_clean":"2023-03-06T14:16:02.637442+0000","last_became_active":"2023-03-06T14:15:58.199288+0000","last_became_peered":"2023-03-06T14:15:58.199288+0000","last_unstale":"2023-03-06T14:16:02.637442+0000","last_undegraded":"2023-03-06T14:16:02.637442+0000","last_fullsized":"2023-03-06T14:16:02.637442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:51.640135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.636887+0000","last_change":"2023-03-06T14:15:58.623642+0000","last_active":"2023-03-06T14:16:02.636887+0000","last_peered":"2023-03-06T14:16:02.636887+0000","last_clean":"2023-03-06T14:16:02.636887+0000","last_became_active":"2023-03-06T14:15:58.623387+0000","last_became_peered":"2023-03-06T14:15:58.623387+0000","last_unstale":"2023-03-06T14:16:02.636887+0000","last_undegraded":"2023-03-06T14:16:02.636887+0000","last_fullsized":"2023-03-06T14:16:02.636887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.355184+0000","last_change":"2023-03-06T14:16:02.639772+0000","last_active":"2023-03-06T14:16:03.355184+0000","last_peered":"2023-03-06T14:16:03.355184+0000","last_clean":"2023-03-06T14:16:03.355184+0000","last_became_active":"2023-03-06T14:16:02.639392+0000","last_became_peered":"2023-03-06T14:16:02.639392+0000","last_unstale":"2023-03-06T14:16:03.355184+0000","last_undegraded":"2023-03-06T14:16:03.355184+0000","last_fullsized":"2023-03-06T14:16:03.355184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:24:14.685213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620927+0000","last_change":"2023-03-06T14:15:58.196943+0000","last_active":"2023-03-06T14:16:02.620927+0000","last_peered":"2023-03-06T14:16:02.620927+0000","last_clean":"2023-03-06T14:16:02.620927+0000","last_became_active":"2023-03-06T14:15:58.196688+0000","last_became_peered":"2023-03-06T14:15:58.196688+0000","last_unstale":"2023-03-06T14:16:02.620927+0000","last_undegraded":"2023-03-06T14:16:02.620927+0000","last_fullsized":"2023-03-06T14:16:02.620927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:12:34.886024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637450+0000","last_change":"2023-03-06T14:15:53.040061+0000","last_active":"2023-03-06T14:16:02.637450+0000","last_peered":"2023-03-06T14:16:02.637450+0000","last_clean":"2023-03-06T14:16:02.637450+0000","last_became_active":"2023-03-06T14:15:53.039743+0000","last_became_peered":"2023-03-06T14:15:53.039743+0000","last_unstale":"2023-03-06T14:16:02.637450+0000","last_undegraded":"2023-03-06T14:16:02.637450+0000","last_fullsized":"2023-03-06T14:16:02.637450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:08:35.979345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620100+0000","last_change":"2023-03-06T14:15:58.630844+0000","last_active":"2023-03-06T14:16:02.620100+0000","last_peered":"2023-03-06T14:16:02.620100+0000","last_clean":"2023-03-06T14:16:02.620100+0000","last_became_active":"2023-03-06T14:15:58.630559+0000","last_became_peered":"2023-03-06T14:15:58.630559+0000","last_unstale":"2023-03-06T14:16:02.620100+0000","last_undegraded":"2023-03-06T14:16:02.620100+0000","last_fullsized":"2023-03-06T14:16:02.620100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046029+0000","last_change":"2023-03-06T14:16:02.642401+0000","last_active":"2023-03-06T14:16:03.046029+0000","last_peered":"2023-03-06T14:16:03.046029+0000","last_clean":"2023-03-06T14:16:03.046029+0000","last_became_active":"2023-03-06T14:16:02.641989+0000","last_became_peered":"2023-03-06T14:16:02.641989+0000","last_unstale":"2023-03-06T14:16:03.046029+0000","last_undegraded":"2023-03-06T14:16:03.046029+0000","last_fullsized":"2023-03-06T14:16:03.046029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:36:04.845196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628635+0000","last_change":"2023-03-06T14:15:53.037412+0000","last_active":"2023-03-06T14:16:02.628635+0000","last_peered":"2023-03-06T14:16:02.628635+0000","last_clean":"2023-03-06T14:16:02.628635+0000","last_became_active":"2023-03-06T14:15:53.037136+0000","last_became_peered":"2023-03-06T14:15:53.037136+0000","last_unstale":"2023-03-06T14:16:02.628635+0000","last_undegraded":"2023-03-06T14:16:02.628635+0000","last_fullsized":"2023-03-06T14:16:02.628635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:27:14.056008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.152637+0000","last_change":"2023-03-06T14:15:58.204500+0000","last_active":"2023-03-06T14:16:03.152637+0000","last_peered":"2023-03-06T14:16:03.152637+0000","last_clean":"2023-03-06T14:16:03.152637+0000","last_became_active":"2023-03-06T14:15:58.204199+0000","last_became_peered":"2023-03-06T14:15:58.204199+0000","last_unstale":"2023-03-06T14:16:03.152637+0000","last_undegraded":"2023-03-06T14:16:03.152637+0000","last_fullsized":"2023-03-06T14:16:03.152637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:35.375050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622127+0000","last_change":"2023-03-06T14:15:58.619009+0000","last_active":"2023-03-06T14:16:02.622127+0000","last_peered":"2023-03-06T14:16:02.622127+0000","last_clean":"2023-03-06T14:16:02.622127+0000","last_became_active":"2023-03-06T14:15:58.618684+0000","last_became_peered":"2023-03-06T14:15:58.618684+0000","last_unstale":"2023-03-06T14:16:02.622127+0000","last_undegraded":"2023-03-06T14:16:02.622127+0000","last_fullsized":"2023-03-06T14:16:02.622127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:23:58.577053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.155165+0000","last_change":"2023-03-06T14:16:02.648262+0000","last_active":"2023-03-06T14:16:03.155165+0000","last_peered":"2023-03-06T14:16:03.155165+0000","last_clean":"2023-03-06T14:16:03.155165+0000","last_became_active":"2023-03-06T14:16:02.647613+0000","last_became_peered":"2023-03-06T14:16:02.647613+0000","last_unstale":"2023-03-06T14:16:03.155165+0000","last_undegraded":"2023-03-06T14:16:03.155165+0000","last_fullsized":"2023-03-06T14:16:03.155165+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:14:39.393308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.636987+0000","last_change":"2023-03-06T14:15:58.199468+0000","last_active":"2023-03-06T14:16:02.636987+0000","last_peered":"2023-03-06T14:16:02.636987+0000","last_clean":"2023-03-06T14:16:02.636987+0000","last_became_active":"2023-03-06T14:15:58.199198+0000","last_became_peered":"2023-03-06T14:15:58.199198+0000","last_unstale":"2023-03-06T14:16:02.636987+0000","last_undegraded":"2023-03-06T14:16:02.636987+0000","last_fullsized":"2023-03-06T14:16:02.636987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:12:34.886024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.634082+0000","last_change":"2023-03-06T14:15:58.625329+0000","last_active":"2023-03-06T14:16:02.634082+0000","last_peered":"2023-03-06T14:16:02.634082+0000","last_clean":"2023-03-06T14:16:02.634082+0000","last_became_active":"2023-03-06T14:15:58.624965+0000","last_became_peered":"2023-03-06T14:15:58.624965+0000","last_unstale":"2023-03-06T14:16:02.634082+0000","last_undegraded":"2023-03-06T14:16:02.634082+0000","last_fullsized":"2023-03-06T14:16:02.634082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:42:03.424567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.354710+0000","last_change":"2023-03-06T14:16:02.647113+0000","last_active":"2023-03-06T14:16:03.354710+0000","last_peered":"2023-03-06T14:16:03.354710+0000","last_clean":"2023-03-06T14:16:03.354710+0000","last_became_active":"2023-03-06T14:16:02.646705+0000","last_became_peered":"2023-03-06T14:16:02.646705+0000","last_unstale":"2023-03-06T14:16:03.354710+0000","last_undegraded":"2023-03-06T14:16:03.354710+0000","last_fullsized":"2023-03-06T14:16:03.354710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:05.636662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621259+0000","last_change":"2023-03-06T14:15:58.196567+0000","last_active":"2023-03-06T14:16:02.621259+0000","last_peered":"2023-03-06T14:16:02.621259+0000","last_clean":"2023-03-06T14:16:02.621259+0000","last_became_active":"2023-03-06T14:15:58.196276+0000","last_became_peered":"2023-03-06T14:15:58.196276+0000","last_unstale":"2023-03-06T14:16:02.621259+0000","last_undegraded":"2023-03-06T14:16:02.621259+0000","last_fullsized":"2023-03-06T14:16:02.621259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:12:34.886024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623223+0000","last_change":"2023-03-06T14:15:58.618271+0000","last_active":"2023-03-06T14:16:02.623223+0000","last_peered":"2023-03-06T14:16:02.623223+0000","last_clean":"2023-03-06T14:16:02.623223+0000","last_became_active":"2023-03-06T14:15:58.617970+0000","last_became_peered":"2023-03-06T14:15:58.617970+0000","last_unstale":"2023-03-06T14:16:02.623223+0000","last_undegraded":"2023-03-06T14:16:02.623223+0000","last_fullsized":"2023-03-06T14:16:02.623223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:11:46.673965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045161+0000","last_change":"2023-03-06T14:16:02.652165+0000","last_active":"2023-03-06T14:16:03.045161+0000","last_peered":"2023-03-06T14:16:03.045161+0000","last_clean":"2023-03-06T14:16:03.045161+0000","last_became_active":"2023-03-06T14:16:02.651741+0000","last_became_peered":"2023-03-06T14:16:02.651741+0000","last_unstale":"2023-03-06T14:16:03.045161+0000","last_undegraded":"2023-03-06T14:16:03.045161+0000","last_fullsized":"2023-03-06T14:16:03.045161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:12:39.833476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623717+0000","last_change":"2023-03-06T14:15:58.197225+0000","last_active":"2023-03-06T14:16:02.623717+0000","last_peered":"2023-03-06T14:16:02.623717+0000","last_clean":"2023-03-06T14:16:02.623717+0000","last_became_active":"2023-03-06T14:15:58.196965+0000","last_became_peered":"2023-03-06T14:15:58.196965+0000","last_unstale":"2023-03-06T14:16:02.623717+0000","last_undegraded":"2023-03-06T14:16:02.623717+0000","last_fullsized":"2023-03-06T14:16:02.623717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:51.640135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623522+0000","last_change":"2023-03-06T14:15:58.618773+0000","last_active":"2023-03-06T14:16:02.623522+0000","last_peered":"2023-03-06T14:16:02.623522+0000","last_clean":"2023-03-06T14:16:02.623522+0000","last_became_active":"2023-03-06T14:15:58.618462+0000","last_became_peered":"2023-03-06T14:15:58.618462+0000","last_unstale":"2023-03-06T14:16:02.623522+0000","last_undegraded":"2023-03-06T14:16:02.623522+0000","last_fullsized":"2023-03-06T14:16:02.623522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:21:50.272173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.353835+0000","last_change":"2023-03-06T14:16:02.646882+0000","last_active":"2023-03-06T14:16:03.353835+0000","last_peered":"2023-03-06T14:16:03.353835+0000","last_clean":"2023-03-06T14:16:03.353835+0000","last_became_active":"2023-03-06T14:16:02.645688+0000","last_became_peered":"2023-03-06T14:16:02.645688+0000","last_unstale":"2023-03-06T14:16:03.353835+0000","last_undegraded":"2023-03-06T14:16:03.353835+0000","last_fullsized":"2023-03-06T14:16:03.353835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:28:49.627966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621195+0000","last_change":"2023-03-06T14:15:58.193377+0000","last_active":"2023-03-06T14:16:02.621195+0000","last_peered":"2023-03-06T14:16:02.621195+0000","last_clean":"2023-03-06T14:16:02.621195+0000","last_became_active":"2023-03-06T14:15:58.192974+0000","last_became_peered":"2023-03-06T14:15:58.192974+0000","last_unstale":"2023-03-06T14:16:02.621195+0000","last_undegraded":"2023-03-06T14:16:02.621195+0000","last_fullsized":"2023-03-06T14:16:02.621195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:35.375050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620221+0000","last_change":"2023-03-06T14:15:58.619235+0000","last_active":"2023-03-06T14:16:02.620221+0000","last_peered":"2023-03-06T14:16:02.620221+0000","last_clean":"2023-03-06T14:16:02.620221+0000","last_became_active":"2023-03-06T14:15:58.618729+0000","last_became_peered":"2023-03-06T14:15:58.618729+0000","last_unstale":"2023-03-06T14:16:02.620221+0000","last_undegraded":"2023-03-06T14:16:02.620221+0000","last_fullsized":"2023-03-06T14:16:02.620221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:21:50.272173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.155032+0000","last_change":"2023-03-06T14:16:02.643512+0000","last_active":"2023-03-06T14:16:03.155032+0000","last_peered":"2023-03-06T14:16:03.155032+0000","last_clean":"2023-03-06T14:16:03.155032+0000","last_became_active":"2023-03-06T14:16:02.643055+0000","last_became_peered":"2023-03-06T14:16:02.643055+0000","last_unstale":"2023-03-06T14:16:03.155032+0000","last_undegraded":"2023-03-06T14:16:03.155032+0000","last_fullsized":"2023-03-06T14:16:03.155032+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:07:17.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633951+0000","last_change":"2023-03-06T14:15:58.197748+0000","last_active":"2023-03-06T14:16:02.633951+0000","last_peered":"2023-03-06T14:16:02.633951+0000","last_clean":"2023-03-06T14:16:02.633951+0000","last_became_active":"2023-03-06T14:15:58.197244+0000","last_became_peered":"2023-03-06T14:15:58.197244+0000","last_unstale":"2023-03-06T14:16:02.633951+0000","last_undegraded":"2023-03-06T14:16:02.633951+0000","last_fullsized":"2023-03-06T14:16:02.633951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:01:51.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621581+0000","last_change":"2023-03-06T14:15:58.618371+0000","last_active":"2023-03-06T14:16:02.621581+0000","last_peered":"2023-03-06T14:16:02.621581+0000","last_clean":"2023-03-06T14:16:02.621581+0000","last_became_active":"2023-03-06T14:15:58.617809+0000","last_became_peered":"2023-03-06T14:15:58.617809+0000","last_unstale":"2023-03-06T14:16:02.621581+0000","last_undegraded":"2023-03-06T14:16:02.621581+0000","last_fullsized":"2023-03-06T14:16:02.621581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:38.013992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628414+0000","last_change":"2023-03-06T14:15:58.623731+0000","last_active":"2023-03-06T14:16:02.628414+0000","last_peered":"2023-03-06T14:16:02.628414+0000","last_clean":"2023-03-06T14:16:02.628414+0000","last_became_active":"2023-03-06T14:15:58.622566+0000","last_became_peered":"2023-03-06T14:15:58.622566+0000","last_unstale":"2023-03-06T14:16:02.628414+0000","last_undegraded":"2023-03-06T14:16:02.628414+0000","last_fullsized":"2023-03-06T14:16:02.628414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:42:03.424567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620436+0000","last_change":"2023-03-06T14:15:58.625127+0000","last_active":"2023-03-06T14:16:02.620436+0000","last_peered":"2023-03-06T14:16:02.620436+0000","last_clean":"2023-03-06T14:16:02.620436+0000","last_became_active":"2023-03-06T14:15:58.624835+0000","last_became_peered":"2023-03-06T14:15:58.624835+0000","last_unstale":"2023-03-06T14:16:02.620436+0000","last_undegraded":"2023-03-06T14:16:02.620436+0000","last_fullsized":"2023-03-06T14:16:02.620436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:20:31.540353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623660+0000","last_change":"2023-03-06T14:15:58.619829+0000","last_active":"2023-03-06T14:16:02.623660+0000","last_peered":"2023-03-06T14:16:02.623660+0000","last_clean":"2023-03-06T14:16:02.623660+0000","last_became_active":"2023-03-06T14:15:58.618933+0000","last_became_peered":"2023-03-06T14:15:58.618933+0000","last_unstale":"2023-03-06T14:16:02.623660+0000","last_undegraded":"2023-03-06T14:16:02.623660+0000","last_fullsized":"2023-03-06T14:16:02.623660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:37:30.914574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620448+0000","last_change":"2023-03-06T14:15:58.630339+0000","last_active":"2023-03-06T14:16:02.620448+0000","last_peered":"2023-03-06T14:16:02.620448+0000","last_clean":"2023-03-06T14:16:02.620448+0000","last_became_active":"2023-03-06T14:15:58.630079+0000","last_became_peered":"2023-03-06T14:15:58.630079+0000","last_unstale":"2023-03-06T14:16:02.620448+0000","last_undegraded":"2023-03-06T14:16:02.620448+0000","last_fullsized":"2023-03-06T14:16:02.620448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:37:30.914574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637592+0000","last_change":"2023-03-06T14:15:58.632453+0000","last_active":"2023-03-06T14:16:02.637592+0000","last_peered":"2023-03-06T14:16:02.637592+0000","last_clean":"2023-03-06T14:16:02.637592+0000","last_became_active":"2023-03-06T14:15:58.632051+0000","last_became_peered":"2023-03-06T14:15:58.632051+0000","last_unstale":"2023-03-06T14:16:02.637592+0000","last_undegraded":"2023-03-06T14:16:02.637592+0000","last_fullsized":"2023-03-06T14:16:02.637592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4528,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9284,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362556,"statfs":{"total":96636764160,"available":96627257344,"internally_reserved":0,"allocated":913408,"data_stored":714231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8164,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363676,"statfs":{"total":96636764160,"available":96628404224,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9260,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362580,"statfs":{"total":96636764160,"available":96627281920,"internally_reserved":0,"allocated":888832,"data_stored":710835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8248,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363592,"statfs":{"total":96636764160,"available":96628318208,"internally_reserved":0,"allocated":311296,"data_stored":123703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8172,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363668,"statfs":{"total":96636764160,"available":96628396032,"internally_reserved":0,"allocated":299008,"data_stored":120537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-06T14:16:23.038 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-06T14:16:23.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.196+0000 7f68f2b4d700 1 Processor -- start 2023-03-06T14:16:23.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.196+0000 7f68f2b4d700 1 -- start start 2023-03-06T14:16:23.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.196+0000 7f68f2b4d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f68ec1491d0 0x7f68ec0c05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:23.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.196+0000 7f68f2b4d700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f68ec0bf4f0 0x7f68ec0c0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:23.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.196+0000 7f68f2b4d700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68ec0c29e0 con 0x7f68ec0c1160 2023-03-06T14:16:23.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.196+0000 7f68f2b4d700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68ec0be680 con 0x7f68ec1491d0 2023-03-06T14:16:23.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.196+0000 7f68f2b4d700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec1495a0 con 0x7f68ec0bf4f0 2023-03-06T14:16:23.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.197+0000 7f68f08e9700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f68ec1491d0 0x7f68ec0c05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:23.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.197+0000 7f68f08e9700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f68ec1491d0 0x7f68ec0c05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56452/0 (socket says 172.21.15.3:56452) 2023-03-06T14:16:23.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.197+0000 7f68f08e9700 1 -- 172.21.15.3:0/1401644910 learned_addr learned my addr 172.21.15.3:0/1401644910 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:23.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.197+0000 7f68ebfff700 1 --2- 172.21.15.3:0/1401644910 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f68ec0bf4f0 0x7f68ec0c0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:23.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.197+0000 7f68f08e9700 1 -- 172.21.15.3:0/1401644910 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f68ec0bf4f0 msgr2=0x7f68ec0c0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:23.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.197+0000 7f68f08e9700 1 --2- 172.21.15.3:0/1401644910 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f68ec0bf4f0 0x7f68ec0c0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.197+0000 7f68f08e9700 1 -- 172.21.15.3:0/1401644910 >> v1:172.21.15.136:6789/0 conn(0x7f68ec0c1160 legacy=0x7f68ec0c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:23.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.197+0000 7f68f08e9700 1 -- 172.21.15.3:0/1401644910 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec14fb60 con 0x7f68ec1491d0 2023-03-06T14:16:23.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.197+0000 7f68f08e9700 1 --2- 172.21.15.3:0/1401644910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68ec1491d0 0x7f68ec0c05e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f68e00098f0 tx=0x7f68e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7960a2798914e85e server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:23.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.197+0000 7f68eb7fe700 1 -- 172.21.15.3:0/1401644910 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0011830 con 0x7f68ec1491d0 2023-03-06T14:16:23.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.197+0000 7f68eb7fe700 1 -- 172.21.15.3:0/1401644910 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e0011990 con 0x7f68ec1491d0 2023-03-06T14:16:23.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.197+0000 7f68eb7fe700 1 -- 172.21.15.3:0/1401644910 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0011d20 con 0x7f68ec1491d0 2023-03-06T14:16:23.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.198+0000 7f68f2b4d700 1 -- 172.21.15.3:0/1401644910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68ec1491d0 msgr2=0x7f68ec0c05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:23.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.198+0000 7f68f2b4d700 1 --2- 172.21.15.3:0/1401644910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68ec1491d0 0x7f68ec0c05e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f68e00098f0 tx=0x7f68e0009c00 comp rx=0 tx=0).stop 2023-03-06T14:16:23.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.198+0000 7f68f2b4d700 1 -- 172.21.15.3:0/1401644910 shutdown_connections 2023-03-06T14:16:23.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.198+0000 7f68f2b4d700 1 --2- 172.21.15.3:0/1401644910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68ec1491d0 0x7f68ec0c05e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.198+0000 7f68f2b4d700 1 --2- 172.21.15.3:0/1401644910 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f68ec0bf4f0 0x7f68ec0c0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.198+0000 7f68f2b4d700 1 -- 172.21.15.3:0/1401644910 >> 172.21.15.3:0/1401644910 conn(0x7f68ec06a2d0 msgr2=0x7f68ec06a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:23.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.198+0000 7f68f2b4d700 1 -- 172.21.15.3:0/1401644910 shutdown_connections 2023-03-06T14:16:23.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.198+0000 7f68f2b4d700 1 -- 172.21.15.3:0/1401644910 wait complete. 2023-03-06T14:16:23.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.199+0000 7f68f2b4d700 1 Processor -- start 2023-03-06T14:16:23.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.199+0000 7f68f2b4d700 1 -- start start 2023-03-06T14:16:23.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.200+0000 7f68f2b4d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68ec0bf4f0 0x7f68ec14e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:23.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.200+0000 7f68f2b4d700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f68ec0c1160 0x7f68ec152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:23.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.200+0000 7f68f2b4d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68ec1491d0 0x7f68ec152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:23.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.200+0000 7f68f2b4d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec130e60 con 0x7f68ec0bf4f0 2023-03-06T14:16:23.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.200+0000 7f68f2b4d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec151280 con 0x7f68ec1491d0 2023-03-06T14:16:23.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.200+0000 7f68f2b4d700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec14eb90 con 0x7f68ec0c1160 2023-03-06T14:16:23.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.200+0000 7f68f08e9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68ec0bf4f0 0x7f68ec14e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:23.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.200+0000 7f68f08e9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68ec0bf4f0 0x7f68ec14e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56458/0 (socket says 172.21.15.3:56458) 2023-03-06T14:16:23.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.200+0000 7f68f08e9700 1 -- 172.21.15.3:0/4155868025 learned_addr learned my addr 172.21.15.3:0/4155868025 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:23.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.200+0000 7f68ebfff700 1 --2- 172.21.15.3:0/4155868025 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f68ec0c1160 0x7f68ec152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:23.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.200+0000 7f68f10ea700 1 --2- 172.21.15.3:0/4155868025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68ec1491d0 0x7f68ec152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:23.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.200+0000 7f68f08e9700 1 -- 172.21.15.3:0/4155868025 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f68ec0c1160 msgr2=0x7f68ec152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:23.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.200+0000 7f68f08e9700 1 --2- 172.21.15.3:0/4155868025 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f68ec0c1160 0x7f68ec152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.200+0000 7f68f08e9700 1 -- 172.21.15.3:0/4155868025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68ec1491d0 msgr2=0x7f68ec152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:23.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.200+0000 7f68f08e9700 1 --2- 172.21.15.3:0/4155868025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68ec1491d0 0x7f68ec152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.200+0000 7f68f08e9700 1 -- 172.21.15.3:0/4155868025 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e0009550 con 0x7f68ec0bf4f0 2023-03-06T14:16:23.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.200+0000 7f68f10ea700 1 --2- 172.21.15.3:0/4155868025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68ec1491d0 0x7f68ec152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:23.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.200+0000 7f68f08e9700 1 --2- 172.21.15.3:0/4155868025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68ec0bf4f0 0x7f68ec14e650 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009c40 tx=0x7f68e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:23.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.201+0000 7f68e97fa700 1 -- 172.21.15.3:0/4155868025 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0004590 con 0x7f68ec0bf4f0 2023-03-06T14:16:23.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.201+0000 7f68e97fa700 1 -- 172.21.15.3:0/4155868025 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e001e070 con 0x7f68ec0bf4f0 2023-03-06T14:16:23.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.201+0000 7f68f2b4d700 1 -- 172.21.15.3:0/4155868025 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ec0bfde0 con 0x7f68ec0bf4f0 2023-03-06T14:16:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.201+0000 7f68e97fa700 1 -- 172.21.15.3:0/4155868025 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e00038e0 con 0x7f68ec0bf4f0 2023-03-06T14:16:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.201+0000 7f68f2b4d700 1 -- 172.21.15.3:0/4155868025 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ec14fe40 con 0x7f68ec0bf4f0 2023-03-06T14:16:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.202+0000 7f68f2b4d700 1 -- 172.21.15.3:0/4155868025 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ec0c00c0 con 0x7f68ec0bf4f0 2023-03-06T14:16:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.202+0000 7f68e97fa700 1 -- 172.21.15.3:0/4155868025 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f68e000f050 con 0x7f68ec0bf4f0 2023-03-06T14:16:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.202+0000 7f68e97fa700 1 --2- 172.21.15.3:0/4155868025 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f68d00682f0 0x7f68d006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.202+0000 7f68e97fa700 1 -- 172.21.15.3:0/4155868025 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f68e0086e70 con 0x7f68ec0bf4f0 2023-03-06T14:16:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.203+0000 7f68ebfff700 1 --2- 172.21.15.3:0/4155868025 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f68d00682f0 0x7f68d006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.203+0000 7f68ebfff700 1 --2- 172.21.15.3:0/4155868025 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f68d00682f0 0x7f68d006a7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f68ec1487d0 tx=0x7f68d8009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:23.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.207+0000 7f68e97fa700 1 -- 172.21.15.3:0/4155868025 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f68e00533e0 con 0x7f68ec0bf4f0 2023-03-06T14:16:23.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.398+0000 7f68f2b4d700 1 -- 172.21.15.3:0/4155868025 --> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68ec04e6e0 con 0x7f68d00682f0 2023-03-06T14:16:23.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.408+0000 7f68e97fa700 1 -- 172.21.15.3:0/4155868025 <== mgr.4107 v2:172.21.15.136:6832/96144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367254 (secure 0 0 0) 0x7f68ec04e6e0 con 0x7f68d00682f0 2023-03-06T14:16:23.413 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:23.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.412+0000 7f68f2b4d700 1 -- 172.21.15.3:0/4155868025 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f68d00682f0 msgr2=0x7f68d006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:23.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.412+0000 7f68f2b4d700 1 --2- 172.21.15.3:0/4155868025 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f68d00682f0 0x7f68d006a7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f68ec1487d0 tx=0x7f68d8009210 comp rx=0 tx=0).stop 2023-03-06T14:16:23.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.412+0000 7f68f2b4d700 1 -- 172.21.15.3:0/4155868025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68ec0bf4f0 msgr2=0x7f68ec14e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:23.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.412+0000 7f68f2b4d700 1 --2- 172.21.15.3:0/4155868025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68ec0bf4f0 0x7f68ec14e650 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009c40 tx=0x7f68e0004750 comp rx=0 tx=0).stop 2023-03-06T14:16:23.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.412+0000 7f68f2b4d700 1 -- 172.21.15.3:0/4155868025 shutdown_connections 2023-03-06T14:16:23.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.412+0000 7f68f2b4d700 1 --2- 172.21.15.3:0/4155868025 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f68d00682f0 0x7f68d006a7a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.412+0000 7f68f2b4d700 1 --2- 172.21.15.3:0/4155868025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68ec0bf4f0 0x7f68ec14e650 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.412+0000 7f68f2b4d700 1 --2- 172.21.15.3:0/4155868025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f68ec1491d0 0x7f68ec152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.412+0000 7f68f2b4d700 1 --2- 172.21.15.3:0/4155868025 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f68ec0c1160 0x7f68ec152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.412+0000 7f68f2b4d700 1 -- 172.21.15.3:0/4155868025 >> 172.21.15.3:0/4155868025 conn(0x7f68ec06a2d0 msgr2=0x7f68ec134ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:23.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.412+0000 7f68f2b4d700 1 -- 172.21.15.3:0/4155868025 shutdown_connections 2023-03-06T14:16:23.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.413+0000 7f68f2b4d700 1 -- 172.21.15.3:0/4155868025 wait complete. 2023-03-06T14:16:23.417 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-03-06T14:16:23.426 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-03-06T14:16:22.970954+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594896,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67496,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907224,"statfs":{"total":773094113280,"available":773024997376,"internally_reserved":0,"allocated":3579904,"data_stored":2149000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003819"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633630+0000","last_change":"2023-03-06T14:15:58.616190+0000","last_active":"2023-03-06T14:16:02.633630+0000","last_peered":"2023-03-06T14:16:02.633630+0000","last_clean":"2023-03-06T14:16:02.633630+0000","last_became_active":"2023-03-06T14:15:58.615955+0000","last_became_peered":"2023-03-06T14:15:58.615955+0000","last_unstale":"2023-03-06T14:16:02.633630+0000","last_undegraded":"2023-03-06T14:16:02.633630+0000","last_fullsized":"2023-03-06T14:16:02.633630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:30:51.239540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622862+0000","last_change":"2023-03-06T14:15:58.627806+0000","last_active":"2023-03-06T14:16:02.622862+0000","last_peered":"2023-03-06T14:16:02.622862+0000","last_clean":"2023-03-06T14:16:02.622862+0000","last_became_active":"2023-03-06T14:15:58.627569+0000","last_became_peered":"2023-03-06T14:15:58.627569+0000","last_unstale":"2023-03-06T14:16:02.622862+0000","last_undegraded":"2023-03-06T14:16:02.622862+0000","last_fullsized":"2023-03-06T14:16:02.622862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:11:22.678656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.624921+0000","last_change":"2023-03-06T14:15:58.620909+0000","last_active":"2023-03-06T14:16:02.624921+0000","last_peered":"2023-03-06T14:16:02.624921+0000","last_clean":"2023-03-06T14:16:02.624921+0000","last_became_active":"2023-03-06T14:15:58.620552+0000","last_became_peered":"2023-03-06T14:15:58.620552+0000","last_unstale":"2023-03-06T14:16:02.624921+0000","last_undegraded":"2023-03-06T14:16:02.624921+0000","last_fullsized":"2023-03-06T14:16:02.624921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:20:36.299681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.627858+0000","last_change":"2023-03-06T14:15:58.620841+0000","last_active":"2023-03-06T14:16:02.627858+0000","last_peered":"2023-03-06T14:16:02.627858+0000","last_clean":"2023-03-06T14:16:02.627858+0000","last_became_active":"2023-03-06T14:15:58.620520+0000","last_became_peered":"2023-03-06T14:15:58.620520+0000","last_unstale":"2023-03-06T14:16:02.627858+0000","last_undegraded":"2023-03-06T14:16:02.627858+0000","last_fullsized":"2023-03-06T14:16:02.627858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:48:05.347666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.634738+0000","last_change":"2023-03-06T14:15:58.617864+0000","last_active":"2023-03-06T14:16:02.634738+0000","last_peered":"2023-03-06T14:16:02.634738+0000","last_clean":"2023-03-06T14:16:02.634738+0000","last_became_active":"2023-03-06T14:15:58.617583+0000","last_became_peered":"2023-03-06T14:15:58.617583+0000","last_unstale":"2023-03-06T14:16:02.634738+0000","last_undegraded":"2023-03-06T14:16:02.634738+0000","last_fullsized":"2023-03-06T14:16:02.634738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:38.013992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623747+0000","last_change":"2023-03-06T14:15:58.622023+0000","last_active":"2023-03-06T14:16:02.623747+0000","last_peered":"2023-03-06T14:16:02.623747+0000","last_clean":"2023-03-06T14:16:02.623747+0000","last_became_active":"2023-03-06T14:15:58.621701+0000","last_became_peered":"2023-03-06T14:15:58.621701+0000","last_unstale":"2023-03-06T14:16:02.623747+0000","last_undegraded":"2023-03-06T14:16:02.623747+0000","last_fullsized":"2023-03-06T14:16:02.623747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:30:29.679092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633939+0000","last_change":"2023-03-06T14:15:58.628504+0000","last_active":"2023-03-06T14:16:02.633939+0000","last_peered":"2023-03-06T14:16:02.633939+0000","last_clean":"2023-03-06T14:16:02.633939+0000","last_became_active":"2023-03-06T14:15:58.625498+0000","last_became_peered":"2023-03-06T14:15:58.625498+0000","last_unstale":"2023-03-06T14:16:02.633939+0000","last_undegraded":"2023-03-06T14:16:02.633939+0000","last_fullsized":"2023-03-06T14:16:02.633939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621014+0000","last_change":"2023-03-06T14:15:58.623919+0000","last_active":"2023-03-06T14:16:02.621014+0000","last_peered":"2023-03-06T14:16:02.621014+0000","last_clean":"2023-03-06T14:16:02.621014+0000","last_became_active":"2023-03-06T14:15:58.623649+0000","last_became_peered":"2023-03-06T14:15:58.623649+0000","last_unstale":"2023-03-06T14:16:02.621014+0000","last_undegraded":"2023-03-06T14:16:02.621014+0000","last_fullsized":"2023-03-06T14:16:02.621014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633659+0000","last_change":"2023-03-06T14:15:58.620112+0000","last_active":"2023-03-06T14:16:02.633659+0000","last_peered":"2023-03-06T14:16:02.633659+0000","last_clean":"2023-03-06T14:16:02.633659+0000","last_became_active":"2023-03-06T14:15:58.619883+0000","last_became_peered":"2023-03-06T14:15:58.619883+0000","last_unstale":"2023-03-06T14:16:02.633659+0000","last_undegraded":"2023-03-06T14:16:02.633659+0000","last_fullsized":"2023-03-06T14:16:02.633659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:37:30.914574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622801+0000","last_change":"2023-03-06T14:15:58.621910+0000","last_active":"2023-03-06T14:16:02.622801+0000","last_peered":"2023-03-06T14:16:02.622801+0000","last_clean":"2023-03-06T14:16:02.622801+0000","last_became_active":"2023-03-06T14:15:58.621587+0000","last_became_peered":"2023-03-06T14:15:58.621587+0000","last_unstale":"2023-03-06T14:16:02.622801+0000","last_undegraded":"2023-03-06T14:16:02.622801+0000","last_fullsized":"2023-03-06T14:16:02.622801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:38.013992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.624901+0000","last_change":"2023-03-06T14:15:58.624755+0000","last_active":"2023-03-06T14:16:02.624901+0000","last_peered":"2023-03-06T14:16:02.624901+0000","last_clean":"2023-03-06T14:16:02.624901+0000","last_became_active":"2023-03-06T14:15:58.624475+0000","last_became_peered":"2023-03-06T14:15:58.624475+0000","last_unstale":"2023-03-06T14:16:02.624901+0000","last_undegraded":"2023-03-06T14:16:02.624901+0000","last_fullsized":"2023-03-06T14:16:02.624901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:18:07.721373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633699+0000","last_change":"2023-03-06T14:15:58.614740+0000","last_active":"2023-03-06T14:16:02.633699+0000","last_peered":"2023-03-06T14:16:02.633699+0000","last_clean":"2023-03-06T14:16:02.633699+0000","last_became_active":"2023-03-06T14:15:58.614438+0000","last_became_peered":"2023-03-06T14:15:58.614438+0000","last_unstale":"2023-03-06T14:16:02.633699+0000","last_undegraded":"2023-03-06T14:16:02.633699+0000","last_fullsized":"2023-03-06T14:16:02.633699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:01:52.021250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633994+0000","last_change":"2023-03-06T14:15:58.616660+0000","last_active":"2023-03-06T14:16:02.633994+0000","last_peered":"2023-03-06T14:16:02.633994+0000","last_clean":"2023-03-06T14:16:02.633994+0000","last_became_active":"2023-03-06T14:15:58.616421+0000","last_became_peered":"2023-03-06T14:15:58.616421+0000","last_unstale":"2023-03-06T14:16:02.633994+0000","last_undegraded":"2023-03-06T14:16:02.633994+0000","last_fullsized":"2023-03-06T14:16:02.633994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:36.384280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620650+0000","last_change":"2023-03-06T14:15:58.621829+0000","last_active":"2023-03-06T14:16:02.620650+0000","last_peered":"2023-03-06T14:16:02.620650+0000","last_clean":"2023-03-06T14:16:02.620650+0000","last_became_active":"2023-03-06T14:15:58.621536+0000","last_became_peered":"2023-03-06T14:15:58.621536+0000","last_unstale":"2023-03-06T14:16:02.620650+0000","last_undegraded":"2023-03-06T14:16:02.620650+0000","last_fullsized":"2023-03-06T14:16:02.620650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:07:29.050347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633730+0000","last_change":"2023-03-06T14:15:58.628671+0000","last_active":"2023-03-06T14:16:02.633730+0000","last_peered":"2023-03-06T14:16:02.633730+0000","last_clean":"2023-03-06T14:16:02.633730+0000","last_became_active":"2023-03-06T14:15:58.625890+0000","last_became_peered":"2023-03-06T14:15:58.625890+0000","last_unstale":"2023-03-06T14:16:02.633730+0000","last_undegraded":"2023-03-06T14:16:02.633730+0000","last_fullsized":"2023-03-06T14:16:02.633730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:52:46.916668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621598+0000","last_change":"2023-03-06T14:15:58.619050+0000","last_active":"2023-03-06T14:16:02.621598+0000","last_peered":"2023-03-06T14:16:02.621598+0000","last_clean":"2023-03-06T14:16:02.621598+0000","last_became_active":"2023-03-06T14:15:58.618773+0000","last_became_peered":"2023-03-06T14:15:58.618773+0000","last_unstale":"2023-03-06T14:16:02.621598+0000","last_undegraded":"2023-03-06T14:16:02.621598+0000","last_fullsized":"2023-03-06T14:16:02.621598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:02.198113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633760+0000","last_change":"2023-03-06T14:15:58.618365+0000","last_active":"2023-03-06T14:16:02.633760+0000","last_peered":"2023-03-06T14:16:02.633760+0000","last_clean":"2023-03-06T14:16:02.633760+0000","last_became_active":"2023-03-06T14:15:58.618051+0000","last_became_peered":"2023-03-06T14:15:58.618051+0000","last_unstale":"2023-03-06T14:16:02.633760+0000","last_undegraded":"2023-03-06T14:16:02.633760+0000","last_fullsized":"2023-03-06T14:16:02.633760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.625083+0000","last_change":"2023-03-06T14:15:58.619631+0000","last_active":"2023-03-06T14:16:02.625083+0000","last_peered":"2023-03-06T14:16:02.625083+0000","last_clean":"2023-03-06T14:16:02.625083+0000","last_became_active":"2023-03-06T14:15:58.619269+0000","last_became_peered":"2023-03-06T14:15:58.619269+0000","last_unstale":"2023-03-06T14:16:02.625083+0000","last_undegraded":"2023-03-06T14:16:02.625083+0000","last_fullsized":"2023-03-06T14:16:02.625083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:37:25.467445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633840+0000","last_change":"2023-03-06T14:15:58.626814+0000","last_active":"2023-03-06T14:16:02.633840+0000","last_peered":"2023-03-06T14:16:02.633840+0000","last_clean":"2023-03-06T14:16:02.633840+0000","last_became_active":"2023-03-06T14:15:58.626375+0000","last_became_peered":"2023-03-06T14:15:58.626375+0000","last_unstale":"2023-03-06T14:16:02.633840+0000","last_undegraded":"2023-03-06T14:16:02.633840+0000","last_fullsized":"2023-03-06T14:16:02.633840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:52.649365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.624599+0000","last_change":"2023-03-06T14:15:58.612672+0000","last_active":"2023-03-06T14:16:02.624599+0000","last_peered":"2023-03-06T14:16:02.624599+0000","last_clean":"2023-03-06T14:16:02.624599+0000","last_became_active":"2023-03-06T14:15:58.612397+0000","last_became_peered":"2023-03-06T14:15:58.612397+0000","last_unstale":"2023-03-06T14:16:02.624599+0000","last_undegraded":"2023-03-06T14:16:02.624599+0000","last_fullsized":"2023-03-06T14:16:02.624599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:11:35.054920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631524+0000","last_change":"2023-03-06T14:15:58.633204+0000","last_active":"2023-03-06T14:16:02.631524+0000","last_peered":"2023-03-06T14:16:02.631524+0000","last_clean":"2023-03-06T14:16:02.631524+0000","last_became_active":"2023-03-06T14:15:58.632916+0000","last_became_peered":"2023-03-06T14:15:58.632916+0000","last_unstale":"2023-03-06T14:16:02.631524+0000","last_undegraded":"2023-03-06T14:16:02.631524+0000","last_fullsized":"2023-03-06T14:16:02.631524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.626753+0000","last_change":"2023-03-06T14:15:58.626811+0000","last_active":"2023-03-06T14:16:02.626753+0000","last_peered":"2023-03-06T14:16:02.626753+0000","last_clean":"2023-03-06T14:16:02.626753+0000","last_became_active":"2023-03-06T14:15:58.626343+0000","last_became_peered":"2023-03-06T14:15:58.626343+0000","last_unstale":"2023-03-06T14:16:02.626753+0000","last_undegraded":"2023-03-06T14:16:02.626753+0000","last_fullsized":"2023-03-06T14:16:02.626753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:38:05.275651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620103+0000","last_change":"2023-03-06T14:15:58.619060+0000","last_active":"2023-03-06T14:16:02.620103+0000","last_peered":"2023-03-06T14:16:02.620103+0000","last_clean":"2023-03-06T14:16:02.620103+0000","last_became_active":"2023-03-06T14:15:58.618364+0000","last_became_peered":"2023-03-06T14:15:58.618364+0000","last_unstale":"2023-03-06T14:16:02.620103+0000","last_undegraded":"2023-03-06T14:16:02.620103+0000","last_fullsized":"2023-03-06T14:16:02.620103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:10:40.167591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631039+0000","last_change":"2023-03-06T14:15:58.633217+0000","last_active":"2023-03-06T14:16:02.631039+0000","last_peered":"2023-03-06T14:16:02.631039+0000","last_clean":"2023-03-06T14:16:02.631039+0000","last_became_active":"2023-03-06T14:15:58.632914+0000","last_became_peered":"2023-03-06T14:15:58.632914+0000","last_unstale":"2023-03-06T14:16:02.631039+0000","last_undegraded":"2023-03-06T14:16:02.631039+0000","last_fullsized":"2023-03-06T14:16:02.631039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637804+0000","last_change":"2023-03-06T14:15:58.623997+0000","last_active":"2023-03-06T14:16:02.637804+0000","last_peered":"2023-03-06T14:16:02.637804+0000","last_clean":"2023-03-06T14:16:02.637804+0000","last_became_active":"2023-03-06T14:15:58.623647+0000","last_became_peered":"2023-03-06T14:15:58.623647+0000","last_unstale":"2023-03-06T14:16:02.637804+0000","last_undegraded":"2023-03-06T14:16:02.637804+0000","last_fullsized":"2023-03-06T14:16:02.637804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:07:29.050347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637576+0000","last_change":"2023-03-06T14:15:58.627972+0000","last_active":"2023-03-06T14:16:02.637576+0000","last_peered":"2023-03-06T14:16:02.637576+0000","last_clean":"2023-03-06T14:16:02.637576+0000","last_became_active":"2023-03-06T14:15:58.624590+0000","last_became_peered":"2023-03-06T14:15:58.624590+0000","last_unstale":"2023-03-06T14:16:02.637576+0000","last_undegraded":"2023-03-06T14:16:02.637576+0000","last_fullsized":"2023-03-06T14:16:02.637576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623548+0000","last_change":"2023-03-06T14:15:58.630237+0000","last_active":"2023-03-06T14:16:02.623548+0000","last_peered":"2023-03-06T14:16:02.623548+0000","last_clean":"2023-03-06T14:16:02.623548+0000","last_became_active":"2023-03-06T14:15:58.629950+0000","last_became_peered":"2023-03-06T14:15:58.629950+0000","last_unstale":"2023-03-06T14:16:02.623548+0000","last_undegraded":"2023-03-06T14:16:02.623548+0000","last_fullsized":"2023-03-06T14:16:02.623548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.355023+0000","last_change":"2023-03-06T14:16:02.646596+0000","last_active":"2023-03-06T14:16:03.355023+0000","last_peered":"2023-03-06T14:16:03.355023+0000","last_clean":"2023-03-06T14:16:03.355023+0000","last_became_active":"2023-03-06T14:16:02.646087+0000","last_became_peered":"2023-03-06T14:16:02.646087+0000","last_unstale":"2023-03-06T14:16:03.355023+0000","last_undegraded":"2023-03-06T14:16:03.355023+0000","last_fullsized":"2023-03-06T14:16:03.355023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:06:47.997273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623579+0000","last_change":"2023-03-06T14:15:58.199019+0000","last_active":"2023-03-06T14:16:02.623579+0000","last_peered":"2023-03-06T14:16:02.623579+0000","last_clean":"2023-03-06T14:16:02.623579+0000","last_became_active":"2023-03-06T14:15:58.198549+0000","last_became_peered":"2023-03-06T14:15:58.198549+0000","last_unstale":"2023-03-06T14:16:02.623579+0000","last_undegraded":"2023-03-06T14:16:02.623579+0000","last_fullsized":"2023-03-06T14:16:02.623579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:38:41.806931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620438+0000","last_change":"2023-03-06T14:15:58.624265+0000","last_active":"2023-03-06T14:16:02.620438+0000","last_peered":"2023-03-06T14:16:02.620438+0000","last_clean":"2023-03-06T14:16:02.620438+0000","last_became_active":"2023-03-06T14:15:58.624013+0000","last_became_peered":"2023-03-06T14:15:58.624013+0000","last_unstale":"2023-03-06T14:16:02.620438+0000","last_undegraded":"2023-03-06T14:16:02.620438+0000","last_fullsized":"2023-03-06T14:16:02.620438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:38.013992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046786+0000","last_change":"2023-03-06T14:16:02.636774+0000","last_active":"2023-03-06T14:16:03.046786+0000","last_peered":"2023-03-06T14:16:03.046786+0000","last_clean":"2023-03-06T14:16:03.046786+0000","last_became_active":"2023-03-06T14:16:02.636419+0000","last_became_peered":"2023-03-06T14:16:02.636419+0000","last_unstale":"2023-03-06T14:16:03.046786+0000","last_undegraded":"2023-03-06T14:16:03.046786+0000","last_fullsized":"2023-03-06T14:16:03.046786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:11:50.112514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.636039+0000","last_change":"2023-03-06T14:15:58.193447+0000","last_active":"2023-03-06T14:16:02.636039+0000","last_peered":"2023-03-06T14:16:02.636039+0000","last_clean":"2023-03-06T14:16:02.636039+0000","last_became_active":"2023-03-06T14:15:58.193156+0000","last_became_peered":"2023-03-06T14:15:58.193156+0000","last_unstale":"2023-03-06T14:16:02.636039+0000","last_undegraded":"2023-03-06T14:16:02.636039+0000","last_fullsized":"2023-03-06T14:16:02.636039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:01:51.926759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631312+0000","last_change":"2023-03-06T14:15:58.631829+0000","last_active":"2023-03-06T14:16:02.631312+0000","last_peered":"2023-03-06T14:16:02.631312+0000","last_clean":"2023-03-06T14:16:02.631312+0000","last_became_active":"2023-03-06T14:15:58.631539+0000","last_became_peered":"2023-03-06T14:15:58.631539+0000","last_unstale":"2023-03-06T14:16:02.631312+0000","last_undegraded":"2023-03-06T14:16:02.631312+0000","last_fullsized":"2023-03-06T14:16:02.631312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:07:29.050347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.152775+0000","last_change":"2023-03-06T14:16:02.651029+0000","last_active":"2023-03-06T14:16:03.152775+0000","last_peered":"2023-03-06T14:16:03.152775+0000","last_clean":"2023-03-06T14:16:03.152775+0000","last_became_active":"2023-03-06T14:16:02.647451+0000","last_became_peered":"2023-03-06T14:16:02.647451+0000","last_unstale":"2023-03-06T14:16:03.152775+0000","last_undegraded":"2023-03-06T14:16:03.152775+0000","last_fullsized":"2023-03-06T14:16:03.152775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:42:32.218248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620790+0000","last_change":"2023-03-06T14:15:58.199612+0000","last_active":"2023-03-06T14:16:02.620790+0000","last_peered":"2023-03-06T14:16:02.620790+0000","last_clean":"2023-03-06T14:16:02.620790+0000","last_became_active":"2023-03-06T14:15:58.199287+0000","last_became_peered":"2023-03-06T14:15:58.199287+0000","last_unstale":"2023-03-06T14:16:02.620790+0000","last_undegraded":"2023-03-06T14:16:02.620790+0000","last_fullsized":"2023-03-06T14:16:02.620790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:01:51.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628754+0000","last_change":"2023-03-06T14:15:58.623084+0000","last_active":"2023-03-06T14:16:02.628754+0000","last_peered":"2023-03-06T14:16:02.628754+0000","last_clean":"2023-03-06T14:16:02.628754+0000","last_became_active":"2023-03-06T14:15:58.622619+0000","last_became_peered":"2023-03-06T14:15:58.622619+0000","last_unstale":"2023-03-06T14:16:02.628754+0000","last_undegraded":"2023-03-06T14:16:02.628754+0000","last_fullsized":"2023-03-06T14:16:02.628754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:55:43.155483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046240+0000","last_change":"2023-03-06T14:16:02.649807+0000","last_active":"2023-03-06T14:16:03.046240+0000","last_peered":"2023-03-06T14:16:03.046240+0000","last_clean":"2023-03-06T14:16:03.046240+0000","last_became_active":"2023-03-06T14:16:02.649413+0000","last_became_peered":"2023-03-06T14:16:02.649413+0000","last_unstale":"2023-03-06T14:16:03.046240+0000","last_undegraded":"2023-03-06T14:16:03.046240+0000","last_fullsized":"2023-03-06T14:16:03.046240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:21:53.710722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633850+0000","last_change":"2023-03-06T14:15:58.198905+0000","last_active":"2023-03-06T14:16:02.633850+0000","last_peered":"2023-03-06T14:16:02.633850+0000","last_clean":"2023-03-06T14:16:02.633850+0000","last_became_active":"2023-03-06T14:15:58.198283+0000","last_became_peered":"2023-03-06T14:15:58.198283+0000","last_unstale":"2023-03-06T14:16:02.633850+0000","last_undegraded":"2023-03-06T14:16:02.633850+0000","last_fullsized":"2023-03-06T14:16:02.633850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:51.640135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620677+0000","last_change":"2023-03-06T14:15:58.629610+0000","last_active":"2023-03-06T14:16:02.620677+0000","last_peered":"2023-03-06T14:16:02.620677+0000","last_clean":"2023-03-06T14:16:02.620677+0000","last_became_active":"2023-03-06T14:15:58.629363+0000","last_became_peered":"2023-03-06T14:15:58.629363+0000","last_unstale":"2023-03-06T14:16:02.620677+0000","last_undegraded":"2023-03-06T14:16:02.620677+0000","last_fullsized":"2023-03-06T14:16:02.620677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.354086+0000","last_change":"2023-03-06T14:16:02.648003+0000","last_active":"2023-03-06T14:16:03.354086+0000","last_peered":"2023-03-06T14:16:03.354086+0000","last_clean":"2023-03-06T14:16:03.354086+0000","last_became_active":"2023-03-06T14:16:02.647584+0000","last_became_peered":"2023-03-06T14:16:02.647584+0000","last_unstale":"2023-03-06T14:16:03.354086+0000","last_undegraded":"2023-03-06T14:16:03.354086+0000","last_fullsized":"2023-03-06T14:16:03.354086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:07:43.686453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622697+0000","last_change":"2023-03-06T14:15:58.196508+0000","last_active":"2023-03-06T14:16:02.622697+0000","last_peered":"2023-03-06T14:16:02.622697+0000","last_clean":"2023-03-06T14:16:02.622697+0000","last_became_active":"2023-03-06T14:15:58.196196+0000","last_became_peered":"2023-03-06T14:15:58.196196+0000","last_unstale":"2023-03-06T14:16:02.622697+0000","last_undegraded":"2023-03-06T14:16:02.622697+0000","last_fullsized":"2023-03-06T14:16:02.622697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:35.375050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620110+0000","last_change":"2023-03-06T14:15:58.630871+0000","last_active":"2023-03-06T14:16:02.620110+0000","last_peered":"2023-03-06T14:16:02.620110+0000","last_clean":"2023-03-06T14:16:02.620110+0000","last_became_active":"2023-03-06T14:15:58.630600+0000","last_became_peered":"2023-03-06T14:15:58.630600+0000","last_unstale":"2023-03-06T14:16:02.620110+0000","last_undegraded":"2023-03-06T14:16:02.620110+0000","last_fullsized":"2023-03-06T14:16:02.620110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:11:46.673965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046607+0000","last_change":"2023-03-06T14:16:02.647406+0000","last_active":"2023-03-06T14:16:03.046607+0000","last_peered":"2023-03-06T14:16:03.046607+0000","last_clean":"2023-03-06T14:16:03.046607+0000","last_became_active":"2023-03-06T14:16:02.646991+0000","last_became_peered":"2023-03-06T14:16:02.646991+0000","last_unstale":"2023-03-06T14:16:03.046607+0000","last_undegraded":"2023-03-06T14:16:03.046607+0000","last_fullsized":"2023-03-06T14:16:03.046607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:08:18.196610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631874+0000","last_change":"2023-03-06T14:15:58.203832+0000","last_active":"2023-03-06T14:16:02.631874+0000","last_peered":"2023-03-06T14:16:02.631874+0000","last_clean":"2023-03-06T14:16:02.631874+0000","last_became_active":"2023-03-06T14:15:58.202151+0000","last_became_peered":"2023-03-06T14:15:58.202151+0000","last_unstale":"2023-03-06T14:16:02.631874+0000","last_undegraded":"2023-03-06T14:16:02.631874+0000","last_fullsized":"2023-03-06T14:16:02.631874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:48:04.338436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637281+0000","last_change":"2023-03-06T14:15:58.623887+0000","last_active":"2023-03-06T14:16:02.637281+0000","last_peered":"2023-03-06T14:16:02.637281+0000","last_clean":"2023-03-06T14:16:02.637281+0000","last_became_active":"2023-03-06T14:15:58.623588+0000","last_became_peered":"2023-03-06T14:15:58.623588+0000","last_unstale":"2023-03-06T14:16:02.637281+0000","last_undegraded":"2023-03-06T14:16:02.637281+0000","last_fullsized":"2023-03-06T14:16:02.637281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:07:29.725804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.154947+0000","last_change":"2023-03-06T14:16:02.640486+0000","last_active":"2023-03-06T14:16:03.154947+0000","last_peered":"2023-03-06T14:16:03.154947+0000","last_clean":"2023-03-06T14:16:03.154947+0000","last_became_active":"2023-03-06T14:16:02.640118+0000","last_became_peered":"2023-03-06T14:16:02.640118+0000","last_unstale":"2023-03-06T14:16:03.154947+0000","last_undegraded":"2023-03-06T14:16:03.154947+0000","last_fullsized":"2023-03-06T14:16:03.154947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:27:58.703596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:14.065253+0000","last_change":"2023-03-06T14:15:58.192763+0000","last_active":"2023-03-06T14:16:14.065253+0000","last_peered":"2023-03-06T14:16:14.065253+0000","last_clean":"2023-03-06T14:16:14.065253+0000","last_became_active":"2023-03-06T14:15:58.192461+0000","last_became_peered":"2023-03-06T14:15:58.192461+0000","last_unstale":"2023-03-06T14:16:14.065253+0000","last_undegraded":"2023-03-06T14:16:14.065253+0000","last_fullsized":"2023-03-06T14:16:14.065253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:29:15.572837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3746,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623479+0000","last_change":"2023-03-06T14:15:58.617934+0000","last_active":"2023-03-06T14:16:02.623479+0000","last_peered":"2023-03-06T14:16:02.623479+0000","last_clean":"2023-03-06T14:16:02.623479+0000","last_became_active":"2023-03-06T14:15:58.617387+0000","last_became_peered":"2023-03-06T14:15:58.617387+0000","last_unstale":"2023-03-06T14:16:02.623479+0000","last_undegraded":"2023-03-06T14:16:02.623479+0000","last_fullsized":"2023-03-06T14:16:02.623479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:18:06.098146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045480+0000","last_change":"2023-03-06T14:16:02.648850+0000","last_active":"2023-03-06T14:16:03.045480+0000","last_peered":"2023-03-06T14:16:03.045480+0000","last_clean":"2023-03-06T14:16:03.045480+0000","last_became_active":"2023-03-06T14:16:02.648464+0000","last_became_peered":"2023-03-06T14:16:02.648464+0000","last_unstale":"2023-03-06T14:16:03.045480+0000","last_undegraded":"2023-03-06T14:16:03.045480+0000","last_fullsized":"2023-03-06T14:16:03.045480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:36:04.845196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631439+0000","last_change":"2023-03-06T14:15:58.196704+0000","last_active":"2023-03-06T14:16:02.631439+0000","last_peered":"2023-03-06T14:16:02.631439+0000","last_clean":"2023-03-06T14:16:02.631439+0000","last_became_active":"2023-03-06T14:15:58.196420+0000","last_became_peered":"2023-03-06T14:15:58.196420+0000","last_unstale":"2023-03-06T14:16:02.631439+0000","last_undegraded":"2023-03-06T14:16:02.631439+0000","last_fullsized":"2023-03-06T14:16:02.631439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:30:50.230310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620609+0000","last_change":"2023-03-06T14:15:58.624384+0000","last_active":"2023-03-06T14:16:02.620609+0000","last_peered":"2023-03-06T14:16:02.620609+0000","last_clean":"2023-03-06T14:16:02.620609+0000","last_became_active":"2023-03-06T14:15:58.624104+0000","last_became_peered":"2023-03-06T14:15:58.624104+0000","last_unstale":"2023-03-06T14:16:02.620609+0000","last_undegraded":"2023-03-06T14:16:02.620609+0000","last_fullsized":"2023-03-06T14:16:02.620609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046476+0000","last_change":"2023-03-06T14:16:02.649893+0000","last_active":"2023-03-06T14:16:03.046476+0000","last_peered":"2023-03-06T14:16:03.046476+0000","last_clean":"2023-03-06T14:16:03.046476+0000","last_became_active":"2023-03-06T14:16:02.649449+0000","last_became_peered":"2023-03-06T14:16:02.649449+0000","last_unstale":"2023-03-06T14:16:03.046476+0000","last_undegraded":"2023-03-06T14:16:03.046476+0000","last_fullsized":"2023-03-06T14:16:03.046476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:16:47.318848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.626428+0000","last_change":"2023-03-06T14:15:58.199816+0000","last_active":"2023-03-06T14:16:02.626428+0000","last_peered":"2023-03-06T14:16:02.626428+0000","last_clean":"2023-03-06T14:16:02.626428+0000","last_became_active":"2023-03-06T14:15:58.198949+0000","last_became_peered":"2023-03-06T14:15:58.198949+0000","last_unstale":"2023-03-06T14:16:02.626428+0000","last_undegraded":"2023-03-06T14:16:02.626428+0000","last_fullsized":"2023-03-06T14:16:02.626428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:38:41.806931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623461+0000","last_change":"2023-03-06T14:15:58.630195+0000","last_active":"2023-03-06T14:16:02.623461+0000","last_peered":"2023-03-06T14:16:02.623461+0000","last_clean":"2023-03-06T14:16:02.623461+0000","last_became_active":"2023-03-06T14:15:58.629926+0000","last_became_peered":"2023-03-06T14:15:58.629926+0000","last_unstale":"2023-03-06T14:16:02.623461+0000","last_undegraded":"2023-03-06T14:16:02.623461+0000","last_fullsized":"2023-03-06T14:16:02.623461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046473+0000","last_change":"2023-03-06T14:16:02.650159+0000","last_active":"2023-03-06T14:16:03.046473+0000","last_peered":"2023-03-06T14:16:03.046473+0000","last_clean":"2023-03-06T14:16:03.046473+0000","last_became_active":"2023-03-06T14:16:02.649734+0000","last_became_peered":"2023-03-06T14:16:02.649734+0000","last_unstale":"2023-03-06T14:16:03.046473+0000","last_undegraded":"2023-03-06T14:16:03.046473+0000","last_fullsized":"2023-03-06T14:16:03.046473+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:12:39.833476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633836+0000","last_change":"2023-03-06T14:15:58.197641+0000","last_active":"2023-03-06T14:16:02.633836+0000","last_peered":"2023-03-06T14:16:02.633836+0000","last_clean":"2023-03-06T14:16:02.633836+0000","last_became_active":"2023-03-06T14:15:58.197332+0000","last_became_peered":"2023-03-06T14:15:58.197332+0000","last_unstale":"2023-03-06T14:16:02.633836+0000","last_undegraded":"2023-03-06T14:16:02.633836+0000","last_fullsized":"2023-03-06T14:16:02.633836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:42:02.415337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631395+0000","last_change":"2023-03-06T14:15:58.619271+0000","last_active":"2023-03-06T14:16:02.631395+0000","last_peered":"2023-03-06T14:16:02.631395+0000","last_clean":"2023-03-06T14:16:02.631395+0000","last_became_active":"2023-03-06T14:15:58.618980+0000","last_became_peered":"2023-03-06T14:15:58.618980+0000","last_unstale":"2023-03-06T14:16:02.631395+0000","last_undegraded":"2023-03-06T14:16:02.631395+0000","last_fullsized":"2023-03-06T14:16:02.631395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045038+0000","last_change":"2023-03-06T14:16:02.641990+0000","last_active":"2023-03-06T14:16:03.045038+0000","last_peered":"2023-03-06T14:16:03.045038+0000","last_clean":"2023-03-06T14:16:03.045038+0000","last_became_active":"2023-03-06T14:16:02.641619+0000","last_became_peered":"2023-03-06T14:16:02.641619+0000","last_unstale":"2023-03-06T14:16:03.045038+0000","last_undegraded":"2023-03-06T14:16:03.045038+0000","last_fullsized":"2023-03-06T14:16:03.045038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:07:17.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628320+0000","last_change":"2023-03-06T14:15:58.199278+0000","last_active":"2023-03-06T14:16:02.628320+0000","last_peered":"2023-03-06T14:16:02.628320+0000","last_clean":"2023-03-06T14:16:02.628320+0000","last_became_active":"2023-03-06T14:15:58.198946+0000","last_became_peered":"2023-03-06T14:15:58.198946+0000","last_unstale":"2023-03-06T14:16:02.628320+0000","last_undegraded":"2023-03-06T14:16:02.628320+0000","last_fullsized":"2023-03-06T14:16:02.628320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:56:39.417304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621143+0000","last_change":"2023-03-06T14:15:58.630272+0000","last_active":"2023-03-06T14:16:02.621143+0000","last_peered":"2023-03-06T14:16:02.621143+0000","last_clean":"2023-03-06T14:16:02.621143+0000","last_became_active":"2023-03-06T14:15:58.630009+0000","last_became_peered":"2023-03-06T14:15:58.630009+0000","last_unstale":"2023-03-06T14:16:02.621143+0000","last_undegraded":"2023-03-06T14:16:02.621143+0000","last_fullsized":"2023-03-06T14:16:02.621143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:11:35.054920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.355117+0000","last_change":"2023-03-06T14:16:02.640631+0000","last_active":"2023-03-06T14:16:03.355117+0000","last_peered":"2023-03-06T14:16:03.355117+0000","last_clean":"2023-03-06T14:16:03.355117+0000","last_became_active":"2023-03-06T14:16:02.640221+0000","last_became_peered":"2023-03-06T14:16:02.640221+0000","last_unstale":"2023-03-06T14:16:03.355117+0000","last_undegraded":"2023-03-06T14:16:03.355117+0000","last_fullsized":"2023-03-06T14:16:03.355117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:27:58.703596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.632795+0000","last_change":"2023-03-06T14:15:58.198789+0000","last_active":"2023-03-06T14:16:02.632795+0000","last_peered":"2023-03-06T14:16:02.632795+0000","last_clean":"2023-03-06T14:16:02.632795+0000","last_became_active":"2023-03-06T14:15:58.197338+0000","last_became_peered":"2023-03-06T14:15:58.197338+0000","last_unstale":"2023-03-06T14:16:02.632795+0000","last_undegraded":"2023-03-06T14:16:02.632795+0000","last_fullsized":"2023-03-06T14:16:02.632795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:55:42.146253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620931+0000","last_change":"2023-03-06T14:15:58.626518+0000","last_active":"2023-03-06T14:16:02.620931+0000","last_peered":"2023-03-06T14:16:02.620931+0000","last_clean":"2023-03-06T14:16:02.620931+0000","last_became_active":"2023-03-06T14:15:58.626233+0000","last_became_peered":"2023-03-06T14:15:58.626233+0000","last_unstale":"2023-03-06T14:16:02.620931+0000","last_undegraded":"2023-03-06T14:16:02.620931+0000","last_fullsized":"2023-03-06T14:16:02.620931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:52:46.916668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291216+0000","last_change":"2023-03-06T14:16:02.650940+0000","last_active":"2023-03-06T14:16:03.291216+0000","last_peered":"2023-03-06T14:16:03.291216+0000","last_clean":"2023-03-06T14:16:03.291216+0000","last_became_active":"2023-03-06T14:16:02.650036+0000","last_became_peered":"2023-03-06T14:16:02.650036+0000","last_unstale":"2023-03-06T14:16:03.291216+0000","last_undegraded":"2023-03-06T14:16:03.291216+0000","last_fullsized":"2023-03-06T14:16:03.291216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:24:02.015602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631826+0000","last_change":"2023-03-06T14:15:58.197042+0000","last_active":"2023-03-06T14:16:02.631826+0000","last_peered":"2023-03-06T14:16:02.631826+0000","last_clean":"2023-03-06T14:16:02.631826+0000","last_became_active":"2023-03-06T14:15:58.196755+0000","last_became_peered":"2023-03-06T14:15:58.196755+0000","last_unstale":"2023-03-06T14:16:02.631826+0000","last_undegraded":"2023-03-06T14:16:02.631826+0000","last_fullsized":"2023-03-06T14:16:02.631826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:05.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622215+0000","last_change":"2023-03-06T14:15:58.624665+0000","last_active":"2023-03-06T14:16:02.622215+0000","last_peered":"2023-03-06T14:16:02.622215+0000","last_clean":"2023-03-06T14:16:02.622215+0000","last_became_active":"2023-03-06T14:15:58.624294+0000","last_became_peered":"2023-03-06T14:15:58.624294+0000","last_unstale":"2023-03-06T14:16:02.622215+0000","last_undegraded":"2023-03-06T14:16:02.622215+0000","last_fullsized":"2023-03-06T14:16:02.622215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:20:31.540353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291400+0000","last_change":"2023-03-06T14:16:02.652542+0000","last_active":"2023-03-06T14:16:03.291400+0000","last_peered":"2023-03-06T14:16:03.291400+0000","last_clean":"2023-03-06T14:16:03.291400+0000","last_became_active":"2023-03-06T14:16:02.652083+0000","last_became_peered":"2023-03-06T14:16:02.652083+0000","last_unstale":"2023-03-06T14:16:03.291400+0000","last_undegraded":"2023-03-06T14:16:03.291400+0000","last_fullsized":"2023-03-06T14:16:03.291400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:18:11.159923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.632018+0000","last_change":"2023-03-06T14:15:58.198266+0000","last_active":"2023-03-06T14:16:02.632018+0000","last_peered":"2023-03-06T14:16:02.632018+0000","last_clean":"2023-03-06T14:16:02.632018+0000","last_became_active":"2023-03-06T14:15:58.197982+0000","last_became_peered":"2023-03-06T14:15:58.197982+0000","last_unstale":"2023-03-06T14:16:02.632018+0000","last_undegraded":"2023-03-06T14:16:02.632018+0000","last_fullsized":"2023-03-06T14:16:02.632018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:35.375050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.627709+0000","last_change":"2023-03-06T14:15:58.626386+0000","last_active":"2023-03-06T14:16:02.627709+0000","last_peered":"2023-03-06T14:16:02.627709+0000","last_clean":"2023-03-06T14:16:02.627709+0000","last_became_active":"2023-03-06T14:15:58.626081+0000","last_became_peered":"2023-03-06T14:15:58.626081+0000","last_unstale":"2023-03-06T14:16:02.627709+0000","last_undegraded":"2023-03-06T14:16:02.627709+0000","last_fullsized":"2023-03-06T14:16:02.627709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:06.411673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291518+0000","last_change":"2023-03-06T14:16:02.645559+0000","last_active":"2023-03-06T14:16:03.291518+0000","last_peered":"2023-03-06T14:16:03.291518+0000","last_clean":"2023-03-06T14:16:03.291518+0000","last_became_active":"2023-03-06T14:16:02.645162+0000","last_became_peered":"2023-03-06T14:16:02.645162+0000","last_unstale":"2023-03-06T14:16:03.291518+0000","last_undegraded":"2023-03-06T14:16:03.291518+0000","last_fullsized":"2023-03-06T14:16:03.291518+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:41.452541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621160+0000","last_change":"2023-03-06T14:15:58.201356+0000","last_active":"2023-03-06T14:16:02.621160+0000","last_peered":"2023-03-06T14:16:02.621160+0000","last_clean":"2023-03-06T14:16:02.621160+0000","last_became_active":"2023-03-06T14:15:58.201039+0000","last_became_peered":"2023-03-06T14:15:58.201039+0000","last_unstale":"2023-03-06T14:16:02.621160+0000","last_undegraded":"2023-03-06T14:16:02.621160+0000","last_fullsized":"2023-03-06T14:16:02.621160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:30:50.230310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637140+0000","last_change":"2023-03-06T14:15:58.626686+0000","last_active":"2023-03-06T14:16:02.637140+0000","last_peered":"2023-03-06T14:16:02.637140+0000","last_clean":"2023-03-06T14:16:02.637140+0000","last_became_active":"2023-03-06T14:15:58.626389+0000","last_became_peered":"2023-03-06T14:15:58.626389+0000","last_unstale":"2023-03-06T14:16:02.637140+0000","last_undegraded":"2023-03-06T14:16:02.637140+0000","last_fullsized":"2023-03-06T14:16:02.637140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:20:31.540353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291620+0000","last_change":"2023-03-06T14:16:02.642347+0000","last_active":"2023-03-06T14:16:03.291620+0000","last_peered":"2023-03-06T14:16:03.291620+0000","last_clean":"2023-03-06T14:16:03.291620+0000","last_became_active":"2023-03-06T14:16:02.641731+0000","last_became_peered":"2023-03-06T14:16:02.641731+0000","last_unstale":"2023-03-06T14:16:03.291620+0000","last_undegraded":"2023-03-06T14:16:03.291620+0000","last_fullsized":"2023-03-06T14:16:03.291620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:44:38.354278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620347+0000","last_change":"2023-03-06T14:15:58.203350+0000","last_active":"2023-03-06T14:16:02.620347+0000","last_peered":"2023-03-06T14:16:02.620347+0000","last_clean":"2023-03-06T14:16:02.620347+0000","last_became_active":"2023-03-06T14:15:58.203061+0000","last_became_peered":"2023-03-06T14:15:58.203061+0000","last_unstale":"2023-03-06T14:16:02.620347+0000","last_undegraded":"2023-03-06T14:16:02.620347+0000","last_fullsized":"2023-03-06T14:16:02.620347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:51.640135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623485+0000","last_change":"2023-03-06T14:15:58.622192+0000","last_active":"2023-03-06T14:16:02.623485+0000","last_peered":"2023-03-06T14:16:02.623485+0000","last_clean":"2023-03-06T14:16:02.623485+0000","last_became_active":"2023-03-06T14:15:58.621902+0000","last_became_peered":"2023-03-06T14:15:58.621902+0000","last_unstale":"2023-03-06T14:16:02.623485+0000","last_undegraded":"2023-03-06T14:16:02.623485+0000","last_fullsized":"2023-03-06T14:16:02.623485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:44:34.915729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.155015+0000","last_change":"2023-03-06T14:16:02.646555+0000","last_active":"2023-03-06T14:16:03.155015+0000","last_peered":"2023-03-06T14:16:03.155015+0000","last_clean":"2023-03-06T14:16:03.155015+0000","last_became_active":"2023-03-06T14:16:02.646107+0000","last_became_peered":"2023-03-06T14:16:02.646107+0000","last_unstale":"2023-03-06T14:16:03.155015+0000","last_undegraded":"2023-03-06T14:16:03.155015+0000","last_fullsized":"2023-03-06T14:16:03.155015+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:07:43.686453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.627804+0000","last_change":"2023-03-06T14:15:58.190228+0000","last_active":"2023-03-06T14:16:02.627804+0000","last_peered":"2023-03-06T14:16:02.627804+0000","last_clean":"2023-03-06T14:16:02.627804+0000","last_became_active":"2023-03-06T14:15:58.189952+0000","last_became_peered":"2023-03-06T14:15:58.189952+0000","last_unstale":"2023-03-06T14:16:02.627804+0000","last_undegraded":"2023-03-06T14:16:02.627804+0000","last_fullsized":"2023-03-06T14:16:02.627804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:29:15.572837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.624802+0000","last_change":"2023-03-06T14:15:58.618284+0000","last_active":"2023-03-06T14:16:02.624802+0000","last_peered":"2023-03-06T14:16:02.624802+0000","last_clean":"2023-03-06T14:16:02.624802+0000","last_became_active":"2023-03-06T14:15:58.617886+0000","last_became_peered":"2023-03-06T14:15:58.617886+0000","last_unstale":"2023-03-06T14:16:02.624802+0000","last_undegraded":"2023-03-06T14:16:02.624802+0000","last_fullsized":"2023-03-06T14:16:02.624802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:10:40.167591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045610+0000","last_change":"2023-03-06T14:16:02.647040+0000","last_active":"2023-03-06T14:16:03.045610+0000","last_peered":"2023-03-06T14:16:03.045610+0000","last_clean":"2023-03-06T14:16:03.045610+0000","last_became_active":"2023-03-06T14:16:02.645423+0000","last_became_peered":"2023-03-06T14:16:02.645423+0000","last_unstale":"2023-03-06T14:16:03.045610+0000","last_undegraded":"2023-03-06T14:16:03.045610+0000","last_fullsized":"2023-03-06T14:16:03.045610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:13:57.742131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622031+0000","last_change":"2023-03-06T14:15:58.197730+0000","last_active":"2023-03-06T14:16:02.622031+0000","last_peered":"2023-03-06T14:16:02.622031+0000","last_clean":"2023-03-06T14:16:02.622031+0000","last_became_active":"2023-03-06T14:15:58.197400+0000","last_became_peered":"2023-03-06T14:15:58.197400+0000","last_unstale":"2023-03-06T14:16:02.622031+0000","last_undegraded":"2023-03-06T14:16:02.622031+0000","last_fullsized":"2023-03-06T14:16:02.622031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:56:39.417304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.625017+0000","last_change":"2023-03-06T14:15:58.615181+0000","last_active":"2023-03-06T14:16:02.625017+0000","last_peered":"2023-03-06T14:16:02.625017+0000","last_clean":"2023-03-06T14:16:02.625017+0000","last_became_active":"2023-03-06T14:15:58.614850+0000","last_became_peered":"2023-03-06T14:15:58.614850+0000","last_unstale":"2023-03-06T14:16:02.625017+0000","last_undegraded":"2023-03-06T14:16:02.625017+0000","last_fullsized":"2023-03-06T14:16:02.625017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.354671+0000","last_change":"2023-03-06T14:16:02.646047+0000","last_active":"2023-03-06T14:16:03.354671+0000","last_peered":"2023-03-06T14:16:03.354671+0000","last_clean":"2023-03-06T14:16:03.354671+0000","last_became_active":"2023-03-06T14:16:02.645633+0000","last_became_peered":"2023-03-06T14:16:02.645633+0000","last_unstale":"2023-03-06T14:16:03.354671+0000","last_undegraded":"2023-03-06T14:16:03.354671+0000","last_fullsized":"2023-03-06T14:16:03.354671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:50:22.369914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620211+0000","last_change":"2023-03-06T14:15:58.203072+0000","last_active":"2023-03-06T14:16:02.620211+0000","last_peered":"2023-03-06T14:16:02.620211+0000","last_clean":"2023-03-06T14:16:02.620211+0000","last_became_active":"2023-03-06T14:15:58.202762+0000","last_became_peered":"2023-03-06T14:15:58.202762+0000","last_unstale":"2023-03-06T14:16:02.620211+0000","last_undegraded":"2023-03-06T14:16:02.620211+0000","last_fullsized":"2023-03-06T14:16:02.620211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:01:51.926759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637882+0000","last_change":"2023-03-06T14:15:58.624080+0000","last_active":"2023-03-06T14:16:02.637882+0000","last_peered":"2023-03-06T14:16:02.637882+0000","last_clean":"2023-03-06T14:16:02.637882+0000","last_became_active":"2023-03-06T14:15:58.623721+0000","last_became_peered":"2023-03-06T14:15:58.623721+0000","last_unstale":"2023-03-06T14:16:02.637882+0000","last_undegraded":"2023-03-06T14:16:02.637882+0000","last_fullsized":"2023-03-06T14:16:02.637882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:52:46.916668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.152408+0000","last_change":"2023-03-06T14:16:02.653426+0000","last_active":"2023-03-06T14:16:03.152408+0000","last_peered":"2023-03-06T14:16:03.152408+0000","last_clean":"2023-03-06T14:16:03.152408+0000","last_became_active":"2023-03-06T14:16:02.653013+0000","last_became_peered":"2023-03-06T14:16:02.653013+0000","last_unstale":"2023-03-06T14:16:03.152408+0000","last_undegraded":"2023-03-06T14:16:03.152408+0000","last_fullsized":"2023-03-06T14:16:03.152408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:07:43.686453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637353+0000","last_change":"2023-03-06T14:15:53.577710+0000","last_active":"2023-03-06T14:16:02.637353+0000","last_peered":"2023-03-06T14:16:02.637353+0000","last_clean":"2023-03-06T14:16:02.637353+0000","last_became_active":"2023-03-06T14:15:53.577390+0000","last_became_peered":"2023-03-06T14:15:53.577390+0000","last_unstale":"2023-03-06T14:16:02.637353+0000","last_undegraded":"2023-03-06T14:16:02.637353+0000","last_fullsized":"2023-03-06T14:16:02.637353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:59:36.846415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623367+0000","last_change":"2023-03-06T14:15:58.201310+0000","last_active":"2023-03-06T14:16:02.623367+0000","last_peered":"2023-03-06T14:16:02.623367+0000","last_clean":"2023-03-06T14:16:02.623367+0000","last_became_active":"2023-03-06T14:15:58.200984+0000","last_became_peered":"2023-03-06T14:15:58.200984+0000","last_unstale":"2023-03-06T14:16:02.623367+0000","last_undegraded":"2023-03-06T14:16:02.623367+0000","last_fullsized":"2023-03-06T14:16:02.623367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:01:51.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637200+0000","last_change":"2023-03-06T14:15:58.624165+0000","last_active":"2023-03-06T14:16:02.637200+0000","last_peered":"2023-03-06T14:16:02.637200+0000","last_clean":"2023-03-06T14:16:02.637200+0000","last_became_active":"2023-03-06T14:15:58.623385+0000","last_became_peered":"2023-03-06T14:15:58.623385+0000","last_unstale":"2023-03-06T14:16:02.637200+0000","last_undegraded":"2023-03-06T14:16:02.637200+0000","last_fullsized":"2023-03-06T14:16:02.637200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:48:05.347666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.152390+0000","last_change":"2023-03-06T14:16:02.648398+0000","last_active":"2023-03-06T14:16:03.152390+0000","last_peered":"2023-03-06T14:16:03.152390+0000","last_clean":"2023-03-06T14:16:03.152390+0000","last_became_active":"2023-03-06T14:16:02.647065+0000","last_became_peered":"2023-03-06T14:16:02.647065+0000","last_unstale":"2023-03-06T14:16:03.152390+0000","last_undegraded":"2023-03-06T14:16:03.152390+0000","last_fullsized":"2023-03-06T14:16:03.152390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:07:17.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620733+0000","last_change":"2023-03-06T14:15:53.036374+0000","last_active":"2023-03-06T14:16:02.620733+0000","last_peered":"2023-03-06T14:16:02.620733+0000","last_clean":"2023-03-06T14:16:02.620733+0000","last_became_active":"2023-03-06T14:15:53.036038+0000","last_became_peered":"2023-03-06T14:15:53.036038+0000","last_unstale":"2023-03-06T14:16:02.620733+0000","last_undegraded":"2023-03-06T14:16:02.620733+0000","last_fullsized":"2023-03-06T14:16:02.620733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:59:36.846415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623310+0000","last_change":"2023-03-06T14:15:58.205953+0000","last_active":"2023-03-06T14:16:02.623310+0000","last_peered":"2023-03-06T14:16:02.623310+0000","last_clean":"2023-03-06T14:16:02.623310+0000","last_became_active":"2023-03-06T14:15:58.205660+0000","last_became_peered":"2023-03-06T14:15:58.205660+0000","last_unstale":"2023-03-06T14:16:02.623310+0000","last_undegraded":"2023-03-06T14:16:02.623310+0000","last_fullsized":"2023-03-06T14:16:02.623310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:01:51.926759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637265+0000","last_change":"2023-03-06T14:15:58.623348+0000","last_active":"2023-03-06T14:16:02.637265+0000","last_peered":"2023-03-06T14:16:02.637265+0000","last_clean":"2023-03-06T14:16:02.637265+0000","last_became_active":"2023-03-06T14:15:58.622915+0000","last_became_peered":"2023-03-06T14:15:58.622915+0000","last_unstale":"2023-03-06T14:16:02.637265+0000","last_undegraded":"2023-03-06T14:16:02.637265+0000","last_fullsized":"2023-03-06T14:16:02.637265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.291678+0000","last_change":"2023-03-06T14:16:02.651042+0000","last_active":"2023-03-06T14:16:03.291678+0000","last_peered":"2023-03-06T14:16:03.291678+0000","last_clean":"2023-03-06T14:16:03.291678+0000","last_became_active":"2023-03-06T14:16:02.650162+0000","last_became_peered":"2023-03-06T14:16:02.650162+0000","last_unstale":"2023-03-06T14:16:03.291678+0000","last_undegraded":"2023-03-06T14:16:03.291678+0000","last_fullsized":"2023-03-06T14:16:03.291678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:37:28.905994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.634164+0000","last_change":"2023-03-06T14:15:53.036522+0000","last_active":"2023-03-06T14:16:02.634164+0000","last_peered":"2023-03-06T14:16:02.634164+0000","last_clean":"2023-03-06T14:16:02.634164+0000","last_became_active":"2023-03-06T14:15:53.036163+0000","last_became_peered":"2023-03-06T14:15:53.036163+0000","last_unstale":"2023-03-06T14:16:02.634164+0000","last_undegraded":"2023-03-06T14:16:02.634164+0000","last_fullsized":"2023-03-06T14:16:02.634164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:27:14.056008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.635952+0000","last_change":"2023-03-06T14:15:58.197803+0000","last_active":"2023-03-06T14:16:02.635952+0000","last_peered":"2023-03-06T14:16:02.635952+0000","last_clean":"2023-03-06T14:16:02.635952+0000","last_became_active":"2023-03-06T14:15:58.197545+0000","last_became_peered":"2023-03-06T14:15:58.197545+0000","last_unstale":"2023-03-06T14:16:02.635952+0000","last_undegraded":"2023-03-06T14:16:02.635952+0000","last_fullsized":"2023-03-06T14:16:02.635952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:12:34.886024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637845+0000","last_change":"2023-03-06T14:15:58.623911+0000","last_active":"2023-03-06T14:16:02.637845+0000","last_peered":"2023-03-06T14:16:02.637845+0000","last_clean":"2023-03-06T14:16:02.637845+0000","last_became_active":"2023-03-06T14:15:58.623425+0000","last_became_peered":"2023-03-06T14:15:58.623425+0000","last_unstale":"2023-03-06T14:16:02.637845+0000","last_undegraded":"2023-03-06T14:16:02.637845+0000","last_fullsized":"2023-03-06T14:16:02.637845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:25:29.813558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.355462+0000","last_change":"2023-03-06T14:16:02.651414+0000","last_active":"2023-03-06T14:16:03.355462+0000","last_peered":"2023-03-06T14:16:03.355462+0000","last_clean":"2023-03-06T14:16:03.355462+0000","last_became_active":"2023-03-06T14:16:02.650987+0000","last_became_peered":"2023-03-06T14:16:02.650987+0000","last_unstale":"2023-03-06T14:16:03.355462+0000","last_undegraded":"2023-03-06T14:16:03.355462+0000","last_fullsized":"2023-03-06T14:16:03.355462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:07:17.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621937+0000","last_change":"2023-03-06T14:15:53.036219+0000","last_active":"2023-03-06T14:16:02.621937+0000","last_peered":"2023-03-06T14:16:02.621937+0000","last_clean":"2023-03-06T14:16:02.621937+0000","last_became_active":"2023-03-06T14:15:53.035884+0000","last_became_peered":"2023-03-06T14:15:53.035884+0000","last_unstale":"2023-03-06T14:16:02.621937+0000","last_undegraded":"2023-03-06T14:16:02.621937+0000","last_fullsized":"2023-03-06T14:16:02.621937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:08:35.979345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":171,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.630995+0000","last_change":"2023-03-06T14:15:46.468596+0000","last_active":"2023-03-06T14:16:02.630995+0000","last_peered":"2023-03-06T14:16:02.630995+0000","last_clean":"2023-03-06T14:16:02.630995+0000","last_became_active":"2023-03-06T14:15:46.467792+0000","last_became_peered":"2023-03-06T14:15:46.467792+0000","last_unstale":"2023-03-06T14:16:02.630995+0000","last_undegraded":"2023-03-06T14:16:02.630995+0000","last_fullsized":"2023-03-06T14:16:02.630995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:45.376343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:45.376343+0000","last_clean_scrub_stamp":"2023-03-06T14:15:45.376343+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:52:08.690494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620179+0000","last_change":"2023-03-06T14:15:58.193624+0000","last_active":"2023-03-06T14:16:02.620179+0000","last_peered":"2023-03-06T14:16:02.620179+0000","last_clean":"2023-03-06T14:16:02.620179+0000","last_became_active":"2023-03-06T14:15:58.192670+0000","last_became_peered":"2023-03-06T14:15:58.192670+0000","last_unstale":"2023-03-06T14:16:02.620179+0000","last_undegraded":"2023-03-06T14:16:02.620179+0000","last_fullsized":"2023-03-06T14:16:02.620179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:56:39.417304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628029+0000","last_change":"2023-03-06T14:15:58.621410+0000","last_active":"2023-03-06T14:16:02.628029+0000","last_peered":"2023-03-06T14:16:02.628029+0000","last_clean":"2023-03-06T14:16:02.628029+0000","last_became_active":"2023-03-06T14:15:58.621119+0000","last_became_peered":"2023-03-06T14:15:58.621119+0000","last_unstale":"2023-03-06T14:16:02.628029+0000","last_undegraded":"2023-03-06T14:16:02.628029+0000","last_fullsized":"2023-03-06T14:16:02.628029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:07:29.725804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045514+0000","last_change":"2023-03-06T14:16:02.647842+0000","last_active":"2023-03-06T14:16:03.045514+0000","last_peered":"2023-03-06T14:16:03.045514+0000","last_clean":"2023-03-06T14:16:03.045514+0000","last_became_active":"2023-03-06T14:16:02.647453+0000","last_became_peered":"2023-03-06T14:16:02.647453+0000","last_unstale":"2023-03-06T14:16:03.045514+0000","last_undegraded":"2023-03-06T14:16:03.045514+0000","last_fullsized":"2023-03-06T14:16:03.045514+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:16:47.318848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631088+0000","last_change":"2023-03-06T14:15:53.037318+0000","last_active":"2023-03-06T14:16:02.631088+0000","last_peered":"2023-03-06T14:16:02.631088+0000","last_clean":"2023-03-06T14:16:02.631088+0000","last_became_active":"2023-03-06T14:15:53.036984+0000","last_became_peered":"2023-03-06T14:15:53.036984+0000","last_unstale":"2023-03-06T14:16:02.631088+0000","last_undegraded":"2023-03-06T14:16:02.631088+0000","last_fullsized":"2023-03-06T14:16:02.631088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:59:36.846415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633034+0000","last_change":"2023-03-06T14:15:58.203061+0000","last_active":"2023-03-06T14:16:02.633034+0000","last_peered":"2023-03-06T14:16:02.633034+0000","last_clean":"2023-03-06T14:16:02.633034+0000","last_became_active":"2023-03-06T14:15:58.202734+0000","last_became_peered":"2023-03-06T14:15:58.202734+0000","last_unstale":"2023-03-06T14:16:02.633034+0000","last_undegraded":"2023-03-06T14:16:02.633034+0000","last_fullsized":"2023-03-06T14:16:02.633034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:56:39.417304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631131+0000","last_change":"2023-03-06T14:15:58.628462+0000","last_active":"2023-03-06T14:16:02.631131+0000","last_peered":"2023-03-06T14:16:02.631131+0000","last_clean":"2023-03-06T14:16:02.631131+0000","last_became_active":"2023-03-06T14:15:58.628169+0000","last_became_peered":"2023-03-06T14:15:58.628169+0000","last_unstale":"2023-03-06T14:16:02.631131+0000","last_undegraded":"2023-03-06T14:16:02.631131+0000","last_fullsized":"2023-03-06T14:16:02.631131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:11:35.054920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046549+0000","last_change":"2023-03-06T14:16:02.651316+0000","last_active":"2023-03-06T14:16:03.046549+0000","last_peered":"2023-03-06T14:16:03.046549+0000","last_clean":"2023-03-06T14:16:03.046549+0000","last_became_active":"2023-03-06T14:16:02.650952+0000","last_became_peered":"2023-03-06T14:16:02.650952+0000","last_unstale":"2023-03-06T14:16:03.046549+0000","last_undegraded":"2023-03-06T14:16:03.046549+0000","last_fullsized":"2023-03-06T14:16:03.046549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:10:43.606141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.631980+0000","last_change":"2023-03-06T14:15:53.577586+0000","last_active":"2023-03-06T14:16:02.631980+0000","last_peered":"2023-03-06T14:16:02.631980+0000","last_clean":"2023-03-06T14:16:02.631980+0000","last_became_active":"2023-03-06T14:15:53.577345+0000","last_became_peered":"2023-03-06T14:15:53.577345+0000","last_unstale":"2023-03-06T14:16:02.631980+0000","last_undegraded":"2023-03-06T14:16:02.631980+0000","last_fullsized":"2023-03-06T14:16:02.631980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:08:35.979345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637442+0000","last_change":"2023-03-06T14:15:58.199583+0000","last_active":"2023-03-06T14:16:02.637442+0000","last_peered":"2023-03-06T14:16:02.637442+0000","last_clean":"2023-03-06T14:16:02.637442+0000","last_became_active":"2023-03-06T14:15:58.199288+0000","last_became_peered":"2023-03-06T14:15:58.199288+0000","last_unstale":"2023-03-06T14:16:02.637442+0000","last_undegraded":"2023-03-06T14:16:02.637442+0000","last_fullsized":"2023-03-06T14:16:02.637442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:51.640135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.636887+0000","last_change":"2023-03-06T14:15:58.623642+0000","last_active":"2023-03-06T14:16:02.636887+0000","last_peered":"2023-03-06T14:16:02.636887+0000","last_clean":"2023-03-06T14:16:02.636887+0000","last_became_active":"2023-03-06T14:15:58.623387+0000","last_became_peered":"2023-03-06T14:15:58.623387+0000","last_unstale":"2023-03-06T14:16:02.636887+0000","last_undegraded":"2023-03-06T14:16:02.636887+0000","last_fullsized":"2023-03-06T14:16:02.636887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:18:51.090975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.355184+0000","last_change":"2023-03-06T14:16:02.639772+0000","last_active":"2023-03-06T14:16:03.355184+0000","last_peered":"2023-03-06T14:16:03.355184+0000","last_clean":"2023-03-06T14:16:03.355184+0000","last_became_active":"2023-03-06T14:16:02.639392+0000","last_became_peered":"2023-03-06T14:16:02.639392+0000","last_unstale":"2023-03-06T14:16:03.355184+0000","last_undegraded":"2023-03-06T14:16:03.355184+0000","last_fullsized":"2023-03-06T14:16:03.355184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:24:14.685213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620927+0000","last_change":"2023-03-06T14:15:58.196943+0000","last_active":"2023-03-06T14:16:02.620927+0000","last_peered":"2023-03-06T14:16:02.620927+0000","last_clean":"2023-03-06T14:16:02.620927+0000","last_became_active":"2023-03-06T14:15:58.196688+0000","last_became_peered":"2023-03-06T14:15:58.196688+0000","last_unstale":"2023-03-06T14:16:02.620927+0000","last_undegraded":"2023-03-06T14:16:02.620927+0000","last_fullsized":"2023-03-06T14:16:02.620927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:12:34.886024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637450+0000","last_change":"2023-03-06T14:15:53.040061+0000","last_active":"2023-03-06T14:16:02.637450+0000","last_peered":"2023-03-06T14:16:02.637450+0000","last_clean":"2023-03-06T14:16:02.637450+0000","last_became_active":"2023-03-06T14:15:53.039743+0000","last_became_peered":"2023-03-06T14:15:53.039743+0000","last_unstale":"2023-03-06T14:16:02.637450+0000","last_undegraded":"2023-03-06T14:16:02.637450+0000","last_fullsized":"2023-03-06T14:16:02.637450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:08:35.979345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620100+0000","last_change":"2023-03-06T14:15:58.630844+0000","last_active":"2023-03-06T14:16:02.620100+0000","last_peered":"2023-03-06T14:16:02.620100+0000","last_clean":"2023-03-06T14:16:02.620100+0000","last_became_active":"2023-03-06T14:15:58.630559+0000","last_became_peered":"2023-03-06T14:15:58.630559+0000","last_unstale":"2023-03-06T14:16:02.620100+0000","last_undegraded":"2023-03-06T14:16:02.620100+0000","last_fullsized":"2023-03-06T14:16:02.620100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:31:54.211334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.046029+0000","last_change":"2023-03-06T14:16:02.642401+0000","last_active":"2023-03-06T14:16:03.046029+0000","last_peered":"2023-03-06T14:16:03.046029+0000","last_clean":"2023-03-06T14:16:03.046029+0000","last_became_active":"2023-03-06T14:16:02.641989+0000","last_became_peered":"2023-03-06T14:16:02.641989+0000","last_unstale":"2023-03-06T14:16:03.046029+0000","last_undegraded":"2023-03-06T14:16:03.046029+0000","last_fullsized":"2023-03-06T14:16:03.046029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:36:04.845196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628635+0000","last_change":"2023-03-06T14:15:53.037412+0000","last_active":"2023-03-06T14:16:02.628635+0000","last_peered":"2023-03-06T14:16:02.628635+0000","last_clean":"2023-03-06T14:16:02.628635+0000","last_became_active":"2023-03-06T14:15:53.037136+0000","last_became_peered":"2023-03-06T14:15:53.037136+0000","last_unstale":"2023-03-06T14:16:02.628635+0000","last_undegraded":"2023-03-06T14:16:02.628635+0000","last_fullsized":"2023-03-06T14:16:02.628635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:52.015380+0000","last_clean_scrub_stamp":"2023-03-06T14:15:52.015380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:27:14.056008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.152637+0000","last_change":"2023-03-06T14:15:58.204500+0000","last_active":"2023-03-06T14:16:03.152637+0000","last_peered":"2023-03-06T14:16:03.152637+0000","last_clean":"2023-03-06T14:16:03.152637+0000","last_became_active":"2023-03-06T14:15:58.204199+0000","last_became_peered":"2023-03-06T14:15:58.204199+0000","last_unstale":"2023-03-06T14:16:03.152637+0000","last_undegraded":"2023-03-06T14:16:03.152637+0000","last_fullsized":"2023-03-06T14:16:03.152637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:35.375050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.622127+0000","last_change":"2023-03-06T14:15:58.619009+0000","last_active":"2023-03-06T14:16:02.622127+0000","last_peered":"2023-03-06T14:16:02.622127+0000","last_clean":"2023-03-06T14:16:02.622127+0000","last_became_active":"2023-03-06T14:15:58.618684+0000","last_became_peered":"2023-03-06T14:15:58.618684+0000","last_unstale":"2023-03-06T14:16:02.622127+0000","last_undegraded":"2023-03-06T14:16:02.622127+0000","last_fullsized":"2023-03-06T14:16:02.622127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:23:58.577053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.155165+0000","last_change":"2023-03-06T14:16:02.648262+0000","last_active":"2023-03-06T14:16:03.155165+0000","last_peered":"2023-03-06T14:16:03.155165+0000","last_clean":"2023-03-06T14:16:03.155165+0000","last_became_active":"2023-03-06T14:16:02.647613+0000","last_became_peered":"2023-03-06T14:16:02.647613+0000","last_unstale":"2023-03-06T14:16:03.155165+0000","last_undegraded":"2023-03-06T14:16:03.155165+0000","last_fullsized":"2023-03-06T14:16:03.155165+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:14:39.393308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.636987+0000","last_change":"2023-03-06T14:15:58.199468+0000","last_active":"2023-03-06T14:16:02.636987+0000","last_peered":"2023-03-06T14:16:02.636987+0000","last_clean":"2023-03-06T14:16:02.636987+0000","last_became_active":"2023-03-06T14:15:58.199198+0000","last_became_peered":"2023-03-06T14:15:58.199198+0000","last_unstale":"2023-03-06T14:16:02.636987+0000","last_undegraded":"2023-03-06T14:16:02.636987+0000","last_fullsized":"2023-03-06T14:16:02.636987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:12:34.886024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.634082+0000","last_change":"2023-03-06T14:15:58.625329+0000","last_active":"2023-03-06T14:16:02.634082+0000","last_peered":"2023-03-06T14:16:02.634082+0000","last_clean":"2023-03-06T14:16:02.634082+0000","last_became_active":"2023-03-06T14:15:58.624965+0000","last_became_peered":"2023-03-06T14:15:58.624965+0000","last_unstale":"2023-03-06T14:16:02.634082+0000","last_undegraded":"2023-03-06T14:16:02.634082+0000","last_fullsized":"2023-03-06T14:16:02.634082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:42:03.424567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.354710+0000","last_change":"2023-03-06T14:16:02.647113+0000","last_active":"2023-03-06T14:16:03.354710+0000","last_peered":"2023-03-06T14:16:03.354710+0000","last_clean":"2023-03-06T14:16:03.354710+0000","last_became_active":"2023-03-06T14:16:02.646705+0000","last_became_peered":"2023-03-06T14:16:02.646705+0000","last_unstale":"2023-03-06T14:16:03.354710+0000","last_undegraded":"2023-03-06T14:16:03.354710+0000","last_fullsized":"2023-03-06T14:16:03.354710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:05.636662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621259+0000","last_change":"2023-03-06T14:15:58.196567+0000","last_active":"2023-03-06T14:16:02.621259+0000","last_peered":"2023-03-06T14:16:02.621259+0000","last_clean":"2023-03-06T14:16:02.621259+0000","last_became_active":"2023-03-06T14:15:58.196276+0000","last_became_peered":"2023-03-06T14:15:58.196276+0000","last_unstale":"2023-03-06T14:16:02.621259+0000","last_undegraded":"2023-03-06T14:16:02.621259+0000","last_fullsized":"2023-03-06T14:16:02.621259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:12:34.886024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623223+0000","last_change":"2023-03-06T14:15:58.618271+0000","last_active":"2023-03-06T14:16:02.623223+0000","last_peered":"2023-03-06T14:16:02.623223+0000","last_clean":"2023-03-06T14:16:02.623223+0000","last_became_active":"2023-03-06T14:15:58.617970+0000","last_became_peered":"2023-03-06T14:15:58.617970+0000","last_unstale":"2023-03-06T14:16:02.623223+0000","last_undegraded":"2023-03-06T14:16:02.623223+0000","last_fullsized":"2023-03-06T14:16:02.623223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:11:46.673965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.045161+0000","last_change":"2023-03-06T14:16:02.652165+0000","last_active":"2023-03-06T14:16:03.045161+0000","last_peered":"2023-03-06T14:16:03.045161+0000","last_clean":"2023-03-06T14:16:03.045161+0000","last_became_active":"2023-03-06T14:16:02.651741+0000","last_became_peered":"2023-03-06T14:16:02.651741+0000","last_unstale":"2023-03-06T14:16:03.045161+0000","last_undegraded":"2023-03-06T14:16:03.045161+0000","last_fullsized":"2023-03-06T14:16:03.045161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:12:39.833476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623717+0000","last_change":"2023-03-06T14:15:58.197225+0000","last_active":"2023-03-06T14:16:02.623717+0000","last_peered":"2023-03-06T14:16:02.623717+0000","last_clean":"2023-03-06T14:16:02.623717+0000","last_became_active":"2023-03-06T14:15:58.196965+0000","last_became_peered":"2023-03-06T14:15:58.196965+0000","last_unstale":"2023-03-06T14:16:02.623717+0000","last_undegraded":"2023-03-06T14:16:02.623717+0000","last_fullsized":"2023-03-06T14:16:02.623717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:10:51.640135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623522+0000","last_change":"2023-03-06T14:15:58.618773+0000","last_active":"2023-03-06T14:16:02.623522+0000","last_peered":"2023-03-06T14:16:02.623522+0000","last_clean":"2023-03-06T14:16:02.623522+0000","last_became_active":"2023-03-06T14:15:58.618462+0000","last_became_peered":"2023-03-06T14:15:58.618462+0000","last_unstale":"2023-03-06T14:16:02.623522+0000","last_undegraded":"2023-03-06T14:16:02.623522+0000","last_fullsized":"2023-03-06T14:16:02.623522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:21:50.272173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.353835+0000","last_change":"2023-03-06T14:16:02.646882+0000","last_active":"2023-03-06T14:16:03.353835+0000","last_peered":"2023-03-06T14:16:03.353835+0000","last_clean":"2023-03-06T14:16:03.353835+0000","last_became_active":"2023-03-06T14:16:02.645688+0000","last_became_peered":"2023-03-06T14:16:02.645688+0000","last_unstale":"2023-03-06T14:16:03.353835+0000","last_undegraded":"2023-03-06T14:16:03.353835+0000","last_fullsized":"2023-03-06T14:16:03.353835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:28:49.627966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621195+0000","last_change":"2023-03-06T14:15:58.193377+0000","last_active":"2023-03-06T14:16:02.621195+0000","last_peered":"2023-03-06T14:16:02.621195+0000","last_clean":"2023-03-06T14:16:02.621195+0000","last_became_active":"2023-03-06T14:15:58.192974+0000","last_became_peered":"2023-03-06T14:15:58.192974+0000","last_unstale":"2023-03-06T14:16:02.621195+0000","last_undegraded":"2023-03-06T14:16:02.621195+0000","last_fullsized":"2023-03-06T14:16:02.621195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:02:35.375050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620221+0000","last_change":"2023-03-06T14:15:58.619235+0000","last_active":"2023-03-06T14:16:02.620221+0000","last_peered":"2023-03-06T14:16:02.620221+0000","last_clean":"2023-03-06T14:16:02.620221+0000","last_became_active":"2023-03-06T14:15:58.618729+0000","last_became_peered":"2023-03-06T14:15:58.618729+0000","last_unstale":"2023-03-06T14:16:02.620221+0000","last_undegraded":"2023-03-06T14:16:02.620221+0000","last_fullsized":"2023-03-06T14:16:02.620221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:21:50.272173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-06T14:16:03.155032+0000","last_change":"2023-03-06T14:16:02.643512+0000","last_active":"2023-03-06T14:16:03.155032+0000","last_peered":"2023-03-06T14:16:03.155032+0000","last_clean":"2023-03-06T14:16:03.155032+0000","last_became_active":"2023-03-06T14:16:02.643055+0000","last_became_peered":"2023-03-06T14:16:02.643055+0000","last_unstale":"2023-03-06T14:16:03.155032+0000","last_undegraded":"2023-03-06T14:16:03.155032+0000","last_fullsized":"2023-03-06T14:16:03.155032+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:16:01.611155+0000","last_clean_scrub_stamp":"2023-03-06T14:16:01.611155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:07:17.949885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.633951+0000","last_change":"2023-03-06T14:15:58.197748+0000","last_active":"2023-03-06T14:16:02.633951+0000","last_peered":"2023-03-06T14:16:02.633951+0000","last_clean":"2023-03-06T14:16:02.633951+0000","last_became_active":"2023-03-06T14:15:58.197244+0000","last_became_peered":"2023-03-06T14:15:58.197244+0000","last_unstale":"2023-03-06T14:16:02.633951+0000","last_undegraded":"2023-03-06T14:16:02.633951+0000","last_fullsized":"2023-03-06T14:16:02.633951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:57.163375+0000","last_clean_scrub_stamp":"2023-03-06T14:15:57.163375+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T02:01:51.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.621581+0000","last_change":"2023-03-06T14:15:58.618371+0000","last_active":"2023-03-06T14:16:02.621581+0000","last_peered":"2023-03-06T14:16:02.621581+0000","last_clean":"2023-03-06T14:16:02.621581+0000","last_became_active":"2023-03-06T14:15:58.617809+0000","last_became_peered":"2023-03-06T14:15:58.617809+0000","last_unstale":"2023-03-06T14:16:02.621581+0000","last_undegraded":"2023-03-06T14:16:02.621581+0000","last_fullsized":"2023-03-06T14:16:02.621581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:13:38.013992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.628414+0000","last_change":"2023-03-06T14:15:58.623731+0000","last_active":"2023-03-06T14:16:02.628414+0000","last_peered":"2023-03-06T14:16:02.628414+0000","last_clean":"2023-03-06T14:16:02.628414+0000","last_became_active":"2023-03-06T14:15:58.622566+0000","last_became_peered":"2023-03-06T14:15:58.622566+0000","last_unstale":"2023-03-06T14:16:02.628414+0000","last_undegraded":"2023-03-06T14:16:02.628414+0000","last_fullsized":"2023-03-06T14:16:02.628414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:42:03.424567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620436+0000","last_change":"2023-03-06T14:15:58.625127+0000","last_active":"2023-03-06T14:16:02.620436+0000","last_peered":"2023-03-06T14:16:02.620436+0000","last_clean":"2023-03-06T14:16:02.620436+0000","last_became_active":"2023-03-06T14:15:58.624835+0000","last_became_peered":"2023-03-06T14:15:58.624835+0000","last_unstale":"2023-03-06T14:16:02.620436+0000","last_undegraded":"2023-03-06T14:16:02.620436+0000","last_fullsized":"2023-03-06T14:16:02.620436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:20:31.540353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.623660+0000","last_change":"2023-03-06T14:15:58.619829+0000","last_active":"2023-03-06T14:16:02.623660+0000","last_peered":"2023-03-06T14:16:02.623660+0000","last_clean":"2023-03-06T14:16:02.623660+0000","last_became_active":"2023-03-06T14:15:58.618933+0000","last_became_peered":"2023-03-06T14:15:58.618933+0000","last_unstale":"2023-03-06T14:16:02.623660+0000","last_undegraded":"2023-03-06T14:16:02.623660+0000","last_fullsized":"2023-03-06T14:16:02.623660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:37:30.914574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.620448+0000","last_change":"2023-03-06T14:15:58.630339+0000","last_active":"2023-03-06T14:16:02.620448+0000","last_peered":"2023-03-06T14:16:02.620448+0000","last_clean":"2023-03-06T14:16:02.620448+0000","last_became_active":"2023-03-06T14:15:58.630079+0000","last_became_peered":"2023-03-06T14:15:58.630079+0000","last_unstale":"2023-03-06T14:16:02.620448+0000","last_undegraded":"2023-03-06T14:16:02.620448+0000","last_fullsized":"2023-03-06T14:16:02.620448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:37:30.914574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-03-06T14:16:02.637592+0000","last_change":"2023-03-06T14:15:58.632453+0000","last_active":"2023-03-06T14:16:02.637592+0000","last_peered":"2023-03-06T14:16:02.637592+0000","last_clean":"2023-03-06T14:16:02.637592+0000","last_became_active":"2023-03-06T14:15:58.632051+0000","last_became_peered":"2023-03-06T14:15:58.632051+0000","last_unstale":"2023-03-06T14:16:02.637592+0000","last_undegraded":"2023-03-06T14:16:02.637592+0000","last_fullsized":"2023-03-06T14:16:02.637592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T14:15:58.172606+0000","last_clean_scrub_stamp":"2023-03-06T14:15:58.172606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:29:53.182957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4528,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9284,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362556,"statfs":{"total":96636764160,"available":96627257344,"internally_reserved":0,"allocated":913408,"data_stored":714231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8164,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363676,"statfs":{"total":96636764160,"available":96628404224,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9260,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362580,"statfs":{"total":96636764160,"available":96627281920,"internally_reserved":0,"allocated":888832,"data_stored":710835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8248,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363592,"statfs":{"total":96636764160,"available":96628318208,"internally_reserved":0,"allocated":311296,"data_stored":123703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8172,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363668,"statfs":{"total":96636764160,"available":96628396032,"internally_reserved":0,"allocated":299008,"data_stored":120537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-06T14:16:23.433 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-03-06T14:16:23.434 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-03-06T14:16:23.434 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-03-06T14:16:23.434 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-03-06T14:16:23.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.588+0000 7fc327b0c700 1 Processor -- start 2023-03-06T14:16:23.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.588+0000 7fc327b0c700 1 -- start start 2023-03-06T14:16:23.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.589+0000 7fc327b0c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc320145e60 0x7fc32006f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:23.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.589+0000 7fc327b0c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc3200b79e0 0x7fc32014fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:23.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.589+0000 7fc327b0c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32014f350 con 0x7fc320146230 2023-03-06T14:16:23.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.589+0000 7fc327b0c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32014f630 con 0x7fc3200b79e0 2023-03-06T14:16:23.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.589+0000 7fc327b0c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32006bff0 con 0x7fc320145e60 2023-03-06T14:16:23.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.589+0000 7fc3250a7700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc3200b79e0 0x7fc32014fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:23.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.589+0000 7fc3260a9700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fc320146230 0x7fc3200bca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58740/0 (socket says 172.21.15.3:58740) 2023-03-06T14:16:23.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.589+0000 7fc3260a9700 1 -- 172.21.15.3:0/1668503049 learned_addr learned my addr 172.21.15.3:0/1668503049 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:23.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.589+0000 7fc3258a8700 1 --2- 172.21.15.3:0/1668503049 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc320145e60 0x7fc32006f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:23.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.589+0000 7fc3250a7700 1 -- 172.21.15.3:0/1668503049 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc320145e60 msgr2=0x7fc32006f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:23.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.589+0000 7fc3250a7700 1 --2- 172.21.15.3:0/1668503049 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc320145e60 0x7fc32006f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.589+0000 7fc3250a7700 1 -- 172.21.15.3:0/1668503049 >> v1:172.21.15.3:6789/0 conn(0x7fc320146230 legacy=0x7fc3200bca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:23.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.589+0000 7fc3250a7700 1 -- 172.21.15.3:0/1668503049 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32006bd10 con 0x7fc3200b79e0 2023-03-06T14:16:23.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.589+0000 7fc3248a6700 1 -- 172.21.15.3:0/1668503049 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238598438 0 0) 0x7fc32014f350 con 0x7fc320146230 2023-03-06T14:16:23.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.589+0000 7fc3258a8700 1 --2- 172.21.15.3:0/1668503049 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc320145e60 0x7fc32006f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:16:23.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.589+0000 7fc3250a7700 1 --2- 172.21.15.3:0/1668503049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3200b79e0 0x7fc32014fac0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc310009840 tx=0x7fc310009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6013df57f13f578 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:23.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.589+0000 7fc3248a6700 1 -- 172.21.15.3:0/1668503049 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310011830 con 0x7fc3200b79e0 2023-03-06T14:16:23.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.589+0000 7fc3248a6700 1 -- 172.21.15.3:0/1668503049 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc310011990 con 0x7fc3200b79e0 2023-03-06T14:16:23.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.589+0000 7fc3248a6700 1 -- 172.21.15.3:0/1668503049 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310011d20 con 0x7fc3200b79e0 2023-03-06T14:16:23.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.590+0000 7fc327b0c700 1 -- 172.21.15.3:0/1668503049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3200b79e0 msgr2=0x7fc32014fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:23.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.590+0000 7fc327b0c700 1 --2- 172.21.15.3:0/1668503049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3200b79e0 0x7fc32014fac0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc310009840 tx=0x7fc310009b50 comp rx=0 tx=0).stop 2023-03-06T14:16:23.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.590+0000 7fc327b0c700 1 -- 172.21.15.3:0/1668503049 shutdown_connections 2023-03-06T14:16:23.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.590+0000 7fc327b0c700 1 --2- 172.21.15.3:0/1668503049 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc320145e60 0x7fc32006f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.590+0000 7fc327b0c700 1 --2- 172.21.15.3:0/1668503049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3200b79e0 0x7fc32014fac0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.590+0000 7fc327b0c700 1 -- 172.21.15.3:0/1668503049 >> 172.21.15.3:0/1668503049 conn(0x7fc320071620 msgr2=0x7fc3200719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:23.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.590+0000 7fc327b0c700 1 -- 172.21.15.3:0/1668503049 shutdown_connections 2023-03-06T14:16:23.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.590+0000 7fc327b0c700 1 -- 172.21.15.3:0/1668503049 wait complete. 2023-03-06T14:16:23.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.591+0000 7fc327b0c700 1 Processor -- start 2023-03-06T14:16:23.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.591+0000 7fc327b0c700 1 -- start start 2023-03-06T14:16:23.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc327b0c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3200b79e0 0x7fc3200c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:23.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc327b0c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc320145e60 0x7fc3201e2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:23.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc327b0c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc320146230 0x7fc320141df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:23.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc327b0c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3201e5d20 con 0x7fc320145e60 2023-03-06T14:16:23.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc327b0c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3201e5f90 con 0x7fc3200b79e0 2023-03-06T14:16:23.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc327b0c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3201e6270 con 0x7fc320146230 2023-03-06T14:16:23.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc3250a7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc320145e60 0x7fc3201e2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:23.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc3250a7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc320145e60 0x7fc3201e2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56472/0 (socket says 172.21.15.3:56472) 2023-03-06T14:16:23.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc3250a7700 1 -- 172.21.15.3:0/215115855 learned_addr learned my addr 172.21.15.3:0/215115855 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:23.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc3260a9700 1 --2- 172.21.15.3:0/215115855 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc320146230 0x7fc320141df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:23.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc3250a7700 1 -- 172.21.15.3:0/215115855 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc320146230 msgr2=0x7fc320141df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:23.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc3258a8700 1 --2- 172.21.15.3:0/215115855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3200b79e0 0x7fc3200c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:23.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc3250a7700 1 --2- 172.21.15.3:0/215115855 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc320146230 0x7fc320141df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc3250a7700 1 -- 172.21.15.3:0/215115855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3200b79e0 msgr2=0x7fc3200c04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:23.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc3250a7700 1 --2- 172.21.15.3:0/215115855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3200b79e0 0x7fc3200c04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc3250a7700 1 -- 172.21.15.3:0/215115855 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3100094a0 con 0x7fc320145e60 2023-03-06T14:16:23.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc3250a7700 1 --2- 172.21.15.3:0/215115855 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc320145e60 0x7fc3201e2710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc310014040 tx=0x7fc310004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:23.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc3167fc700 1 -- 172.21.15.3:0/215115855 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3100038a0 con 0x7fc320145e60 2023-03-06T14:16:23.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc3167fc700 1 -- 172.21.15.3:0/215115855 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31001e070 con 0x7fc320145e60 2023-03-06T14:16:23.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.592+0000 7fc327b0c700 1 -- 172.21.15.3:0/215115855 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32014bd60 con 0x7fc320145e60 2023-03-06T14:16:23.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.593+0000 7fc3167fc700 1 -- 172.21.15.3:0/215115855 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310003c40 con 0x7fc320145e60 2023-03-06T14:16:23.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.593+0000 7fc327b0c700 1 -- 172.21.15.3:0/215115855 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3200be600 con 0x7fc320145e60 2023-03-06T14:16:23.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.593+0000 7fc327b0c700 1 -- 172.21.15.3:0/215115855 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32006df60 con 0x7fc320145e60 2023-03-06T14:16:23.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.594+0000 7fc3167fc700 1 -- 172.21.15.3:0/215115855 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc31000f050 con 0x7fc320145e60 2023-03-06T14:16:23.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.595+0000 7fc3167fc700 1 --2- 172.21.15.3:0/215115855 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc3040682f0 0x7fc30406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:23.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.595+0000 7fc3167fc700 1 -- 172.21.15.3:0/215115855 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc310087520 con 0x7fc320145e60 2023-03-06T14:16:23.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.595+0000 7fc3258a8700 1 --2- 172.21.15.3:0/215115855 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc3040682f0 0x7fc30406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:23.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.596+0000 7fc3258a8700 1 --2- 172.21.15.3:0/215115855 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc3040682f0 0x7fc30406a7a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc31c006fd0 tx=0x7fc31c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:23.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.598+0000 7fc3167fc700 1 -- 172.21.15.3:0/215115855 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc310053b30 con 0x7fc320145e60 2023-03-06T14:16:23.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.835+0000 7fc327b0c700 1 -- 172.21.15.3:0/215115855 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc3201e6790 con 0x7fc320145e60 2023-03-06T14:16:23.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.836+0000 7fc3167fc700 1 -- 172.21.15.3:0/215115855 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fc3201e6790 con 0x7fc320145e60 2023-03-06T14:16:23.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:23.837 INFO:teuthology.orchestra.run.smithi003.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-03-06T14:16:23.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.837+0000 7fc327b0c700 1 -- 172.21.15.3:0/215115855 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc3040682f0 msgr2=0x7fc30406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:23.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.837+0000 7fc327b0c700 1 --2- 172.21.15.3:0/215115855 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc3040682f0 0x7fc30406a7a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc31c006fd0 tx=0x7fc31c008040 comp rx=0 tx=0).stop 2023-03-06T14:16:23.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.837+0000 7fc327b0c700 1 -- 172.21.15.3:0/215115855 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc320145e60 msgr2=0x7fc3201e2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:23.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.837+0000 7fc327b0c700 1 --2- 172.21.15.3:0/215115855 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc320145e60 0x7fc3201e2710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc310014040 tx=0x7fc310004750 comp rx=0 tx=0).stop 2023-03-06T14:16:23.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.838+0000 7fc327b0c700 1 -- 172.21.15.3:0/215115855 shutdown_connections 2023-03-06T14:16:23.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.838+0000 7fc327b0c700 1 --2- 172.21.15.3:0/215115855 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fc3040682f0 0x7fc30406a7a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.838+0000 7fc327b0c700 1 --2- 172.21.15.3:0/215115855 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc320146230 0x7fc320141df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.838+0000 7fc327b0c700 1 --2- 172.21.15.3:0/215115855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3200b79e0 0x7fc3200c04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.838+0000 7fc327b0c700 1 --2- 172.21.15.3:0/215115855 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc320145e60 0x7fc3201e2710 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.838+0000 7fc327b0c700 1 -- 172.21.15.3:0/215115855 >> 172.21.15.3:0/215115855 conn(0x7fc320071620 msgr2=0x7fc320149fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:23.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.838+0000 7fc327b0c700 1 -- 172.21.15.3:0/215115855 shutdown_connections 2023-03-06T14:16:23.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.838+0000 7fc327b0c700 1 -- 172.21.15.3:0/215115855 wait complete. 2023-03-06T14:16:23.851 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-03-06T14:16:23.851 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T14:16:23.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.974+0000 7faa85c16700 1 Processor -- start 2023-03-06T14:16:23.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.974+0000 7faa85c16700 1 -- start start 2023-03-06T14:16:23.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.975+0000 7faa85c16700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7faa800bf210 0x7faa80146950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:23.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.975+0000 7faa85c16700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa800c16e0 con 0x7faa8006fde0 2023-03-06T14:16:23.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.975+0000 7faa85c16700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa80070670 con 0x7faa800c1fe0 2023-03-06T14:16:23.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.975+0000 7faa85c16700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa800c23b0 con 0x7faa800bf210 2023-03-06T14:16:23.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.975+0000 7faa7ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7faa800bf210 0x7faa80146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:23.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.975+0000 7faa7ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7faa800bf210 0x7faa80146950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56482/0 (socket says 172.21.15.3:56482) 2023-03-06T14:16:23.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.975+0000 7faa7ffff700 1 -- 172.21.15.3:0/3498687612 learned_addr learned my addr 172.21.15.3:0/3498687612 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:23.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.975+0000 7faa7effd700 1 --1- 172.21.15.3:0/3498687612 >> v1:172.21.15.3:6789/0 conn(0x7faa8006fde0 0x7faa800beb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58752/0 (socket says 172.21.15.3:58752) 2023-03-06T14:16:23.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.976+0000 7faa7ffff700 1 -- 172.21.15.3:0/3498687612 >> v1:172.21.15.136:6789/0 conn(0x7faa800c1fe0 legacy=0x7faa800c0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:23.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.976+0000 7faa7ffff700 1 -- 172.21.15.3:0/3498687612 >> v1:172.21.15.3:6789/0 conn(0x7faa8006fde0 legacy=0x7faa800beb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:23.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.976+0000 7faa7e7fc700 1 -- 172.21.15.3:0/3498687612 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108843649 0 0) 0x7faa800c16e0 con 0x7faa8006fde0 2023-03-06T14:16:23.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.976+0000 7faa7ffff700 1 -- 172.21.15.3:0/3498687612 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa80151070 con 0x7faa800bf210 2023-03-06T14:16:23.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.976+0000 7faa7ffff700 1 --2- 172.21.15.3:0/3498687612 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa800bf210 0x7faa80146950 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faa78009e50 tx=0x7faa7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69faf7f50f6fc0c6 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:23.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.976+0000 7faa7e7fc700 1 -- 172.21.15.3:0/3498687612 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7800e070 con 0x7faa800bf210 2023-03-06T14:16:23.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.976+0000 7faa7e7fc700 1 -- 172.21.15.3:0/3498687612 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa78003a20 con 0x7faa800bf210 2023-03-06T14:16:23.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.976+0000 7faa7e7fc700 1 -- 172.21.15.3:0/3498687612 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa78003dd0 con 0x7faa800bf210 2023-03-06T14:16:23.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.976+0000 7faa85c16700 1 -- 172.21.15.3:0/3498687612 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa800bf210 msgr2=0x7faa80146950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:23.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.976+0000 7faa85c16700 1 --2- 172.21.15.3:0/3498687612 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa800bf210 0x7faa80146950 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faa78009e50 tx=0x7faa7800b330 comp rx=0 tx=0).stop 2023-03-06T14:16:23.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.977+0000 7faa85c16700 1 -- 172.21.15.3:0/3498687612 shutdown_connections 2023-03-06T14:16:23.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.977+0000 7faa85c16700 1 --2- 172.21.15.3:0/3498687612 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa800bf210 0x7faa80146950 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.977+0000 7faa85c16700 1 -- 172.21.15.3:0/3498687612 >> 172.21.15.3:0/3498687612 conn(0x7faa800c31d0 msgr2=0x7faa800c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:23.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.977+0000 7faa85c16700 1 -- 172.21.15.3:0/3498687612 shutdown_connections 2023-03-06T14:16:23.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.977+0000 7faa85c16700 1 -- 172.21.15.3:0/3498687612 wait complete. 2023-03-06T14:16:23.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.978+0000 7faa85c16700 1 Processor -- start 2023-03-06T14:16:23.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.978+0000 7faa85c16700 1 -- start start 2023-03-06T14:16:23.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.979+0000 7faa85c16700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa8006fde0 0x7faa800bb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:23.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.979+0000 7faa85c16700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa800bf210 0x7faa800bbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:23.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.979+0000 7faa85c16700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa800c1fe0 0x7faa801e5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:23.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.979+0000 7faa85c16700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa800bb850 con 0x7faa8006fde0 2023-03-06T14:16:23.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.979+0000 7faa85c16700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa800b9e30 con 0x7faa800c1fe0 2023-03-06T14:16:23.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.979+0000 7faa85c16700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa800b9390 con 0x7faa800bf210 2023-03-06T14:16:23.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.979+0000 7faa7f7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa8006fde0 0x7faa800bb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:23.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.979+0000 7faa7f7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa8006fde0 0x7faa800bb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56484/0 (socket says 172.21.15.3:56484) 2023-03-06T14:16:23.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.979+0000 7faa7f7fe700 1 -- 172.21.15.3:0/3402816721 learned_addr learned my addr 172.21.15.3:0/3402816721 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:23.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.980+0000 7faa7effd700 1 --2- 172.21.15.3:0/3402816721 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa800bf210 0x7faa800bbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:23.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.980+0000 7faa7ffff700 1 --2- 172.21.15.3:0/3402816721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa800c1fe0 0x7faa801e5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:23.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.980+0000 7faa7f7fe700 1 -- 172.21.15.3:0/3402816721 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa800bf210 msgr2=0x7faa800bbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:23.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.980+0000 7faa7f7fe700 1 --2- 172.21.15.3:0/3402816721 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa800bf210 0x7faa800bbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.980+0000 7faa7f7fe700 1 -- 172.21.15.3:0/3402816721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa800c1fe0 msgr2=0x7faa801e5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:23.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.980+0000 7faa7f7fe700 1 --2- 172.21.15.3:0/3402816721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa800c1fe0 0x7faa801e5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:23.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.980+0000 7faa7f7fe700 1 -- 172.21.15.3:0/3402816721 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa78009b30 con 0x7faa8006fde0 2023-03-06T14:16:23.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.980+0000 7faa7ffff700 1 --2- 172.21.15.3:0/3402816721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa800c1fe0 0x7faa801e5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:16:23.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.980+0000 7faa7f7fe700 1 --2- 172.21.15.3:0/3402816721 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa8006fde0 0x7faa800bb310 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faa7000c4d0 tx=0x7faa7000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:23.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.980+0000 7faa67fff700 1 -- 172.21.15.3:0/3402816721 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa70011790 con 0x7faa8006fde0 2023-03-06T14:16:23.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.980+0000 7faa67fff700 1 -- 172.21.15.3:0/3402816721 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa700118f0 con 0x7faa8006fde0 2023-03-06T14:16:23.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.980+0000 7faa85c16700 1 -- 172.21.15.3:0/3402816721 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa800c2600 con 0x7faa8006fde0 2023-03-06T14:16:23.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.980+0000 7faa67fff700 1 -- 172.21.15.3:0/3402816721 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa70011ca0 con 0x7faa8006fde0 2023-03-06T14:16:23.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.980+0000 7faa85c16700 1 -- 172.21.15.3:0/3402816721 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa80151350 con 0x7faa8006fde0 2023-03-06T14:16:23.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.981+0000 7faa85c16700 1 -- 172.21.15.3:0/3402816721 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa800bf9f0 con 0x7faa8006fde0 2023-03-06T14:16:23.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.981+0000 7faa67fff700 1 -- 172.21.15.3:0/3402816721 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7faa70010050 con 0x7faa8006fde0 2023-03-06T14:16:23.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.982+0000 7faa67fff700 1 --2- 172.21.15.3:0/3402816721 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7faa6c0682f0 0x7faa6c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:23.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.982+0000 7faa67fff700 1 -- 172.21.15.3:0/3402816721 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faa70085d00 con 0x7faa8006fde0 2023-03-06T14:16:23.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.982+0000 7faa7effd700 1 --2- 172.21.15.3:0/3402816721 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7faa6c0682f0 0x7faa6c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:23.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.983+0000 7faa7effd700 1 --2- 172.21.15.3:0/3402816721 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7faa6c0682f0 0x7faa6c06a7a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faa800a4270 tx=0x7faa74007c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:23.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:23.986+0000 7faa67fff700 1 -- 172.21.15.3:0/3402816721 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7faa70089030 con 0x7faa8006fde0 2023-03-06T14:16:24.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.179+0000 7faa85c16700 1 -- 172.21.15.3:0/3402816721 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa800729e0 con 0x7faa8006fde0 2023-03-06T14:16:24.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.180+0000 7faa67fff700 1 -- 172.21.15.3:0/3402816721 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19604 (secure 0 0 0) 0x7faa700521f0 con 0x7faa8006fde0 2023-03-06T14:16:24.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:24.182 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":27,"fsid":"9aae2361-5af0-49eb-8f99-e7f69834fedf","created":"2023-03-06T14:15:33.357348+0000","modified":"2023-03-06T14:16:03.040402+0000","last_up_change":"2023-03-06T14:15:44.374764+0000","last_in_change":"2023-03-06T14:15:35.866803+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T14:15:45.023761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T14:15:51.830917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-06T14:15:56.256188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-06T14:15:57.571429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-06T14:16:00.645210+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c92c9e49-8a23-48a5-87e5-51f184f73a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":96679},{"type":"v1","addr":"172.21.15.3:6809","nonce":96679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":96679},{"type":"v1","addr":"172.21.15.3:6811","nonce":96679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":96679},{"type":"v1","addr":"172.21.15.3:6818","nonce":96679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":96679},{"type":"v1","addr":"172.21.15.3:6814","nonce":96679}]},"public_addr":"172.21.15.3:6809/96679","cluster_addr":"172.21.15.3:6811/96679","heartbeat_back_addr":"172.21.15.3:6818/96679","heartbeat_front_addr":"172.21.15.3:6814/96679","state":["exists","up"]},{"osd":1,"uuid":"86ec9127-843f-4246-bfbe-e14ce3af7d17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":96681},{"type":"v1","addr":"172.21.15.3:6825","nonce":96681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":96681},{"type":"v1","addr":"172.21.15.3:6827","nonce":96681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":96681},{"type":"v1","addr":"172.21.15.3:6831","nonce":96681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":96681},{"type":"v1","addr":"172.21.15.3:6829","nonce":96681}]},"public_addr":"172.21.15.3:6825/96681","cluster_addr":"172.21.15.3:6827/96681","heartbeat_back_addr":"172.21.15.3:6831/96681","heartbeat_front_addr":"172.21.15.3:6829/96681","state":["exists","up"]},{"osd":2,"uuid":"67582de3-0f75-4cf0-84ca-e878986f99f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6813","nonce":96682},{"type":"v1","addr":"172.21.15.3:6815","nonce":96682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6817","nonce":96682},{"type":"v1","addr":"172.21.15.3:6819","nonce":96682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":96682},{"type":"v1","addr":"172.21.15.3:6823","nonce":96682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":96682},{"type":"v1","addr":"172.21.15.3:6821","nonce":96682}]},"public_addr":"172.21.15.3:6815/96682","cluster_addr":"172.21.15.3:6819/96682","heartbeat_back_addr":"172.21.15.3:6823/96682","heartbeat_front_addr":"172.21.15.3:6821/96682","state":["exists","up"]},{"osd":3,"uuid":"0fb8d708-4b38-4153-8a60-79741765d439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":96680},{"type":"v1","addr":"172.21.15.3:6801","nonce":96680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":96680},{"type":"v1","addr":"172.21.15.3:6803","nonce":96680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":96680},{"type":"v1","addr":"172.21.15.3:6807","nonce":96680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":96680},{"type":"v1","addr":"172.21.15.3:6805","nonce":96680}]},"public_addr":"172.21.15.3:6801/96680","cluster_addr":"172.21.15.3:6803/96680","heartbeat_back_addr":"172.21.15.3:6807/96680","heartbeat_front_addr":"172.21.15.3:6805/96680","state":["exists","up"]},{"osd":4,"uuid":"44eb9d99-975f-43a3-8bf4-213b2ba6dea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":96798},{"type":"v1","addr":"172.21.15.136:6822","nonce":96798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":96798},{"type":"v1","addr":"172.21.15.136:6826","nonce":96798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":96798},{"type":"v1","addr":"172.21.15.136:6831","nonce":96798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":96798},{"type":"v1","addr":"172.21.15.136:6829","nonce":96798}]},"public_addr":"172.21.15.136:6822/96798","cluster_addr":"172.21.15.136:6826/96798","heartbeat_back_addr":"172.21.15.136:6831/96798","heartbeat_front_addr":"172.21.15.136:6829/96798","state":["exists","up"]},{"osd":5,"uuid":"aff1a438-c444-4ebc-9806-d2d117878a2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":96796},{"type":"v1","addr":"172.21.15.136:6804","nonce":96796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6807","nonce":96796},{"type":"v1","addr":"172.21.15.136:6809","nonce":96796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":96796},{"type":"v1","addr":"172.21.15.136:6815","nonce":96796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":96796},{"type":"v1","addr":"172.21.15.136:6813","nonce":96796}]},"public_addr":"172.21.15.136:6804/96796","cluster_addr":"172.21.15.136:6809/96796","heartbeat_back_addr":"172.21.15.136:6815/96796","heartbeat_front_addr":"172.21.15.136:6813/96796","state":["exists","up"]},{"osd":6,"uuid":"89cc219c-f57b-43f4-8e54-76017dd4930d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":96797},{"type":"v1","addr":"172.21.15.136:6801","nonce":96797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6803","nonce":96797},{"type":"v1","addr":"172.21.15.136:6805","nonce":96797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":96797},{"type":"v1","addr":"172.21.15.136:6811","nonce":96797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":96797},{"type":"v1","addr":"172.21.15.136:6808","nonce":96797}]},"public_addr":"172.21.15.136:6801/96797","cluster_addr":"172.21.15.136:6805/96797","heartbeat_back_addr":"172.21.15.136:6811/96797","heartbeat_front_addr":"172.21.15.136:6808/96797","state":["exists","up"]},{"osd":7,"uuid":"a90e4c14-00de-4d1c-92ce-9f20df714e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":96819},{"type":"v1","addr":"172.21.15.136:6817","nonce":96819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":96819},{"type":"v1","addr":"172.21.15.136:6819","nonce":96819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":96819},{"type":"v1","addr":"172.21.15.136:6827","nonce":96819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":96819},{"type":"v1","addr":"172.21.15.136:6823","nonce":96819}]},"public_addr":"172.21.15.136:6817/96819","cluster_addr":"172.21.15.136:6819/96819","heartbeat_back_addr":"172.21.15.136:6827/96819","heartbeat_front_addr":"172.21.15.136:6823/96819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.093141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.034488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.128137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.097924+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.045441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.005820+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.039918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T14:15:41.082053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T14:16:24.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.182+0000 7faa85c16700 1 -- 172.21.15.3:0/3402816721 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7faa6c0682f0 msgr2=0x7faa6c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:24.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.182+0000 7faa85c16700 1 --2- 172.21.15.3:0/3402816721 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7faa6c0682f0 0x7faa6c06a7a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faa800a4270 tx=0x7faa74007c90 comp rx=0 tx=0).stop 2023-03-06T14:16:24.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.182+0000 7faa85c16700 1 -- 172.21.15.3:0/3402816721 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa8006fde0 msgr2=0x7faa800bb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:24.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.182+0000 7faa85c16700 1 --2- 172.21.15.3:0/3402816721 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa8006fde0 0x7faa800bb310 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faa7000c4d0 tx=0x7faa7000c890 comp rx=0 tx=0).stop 2023-03-06T14:16:24.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.182+0000 7faa85c16700 1 -- 172.21.15.3:0/3402816721 shutdown_connections 2023-03-06T14:16:24.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.182+0000 7faa85c16700 1 --2- 172.21.15.3:0/3402816721 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7faa6c0682f0 0x7faa6c06a7a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.182+0000 7faa85c16700 1 --2- 172.21.15.3:0/3402816721 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa8006fde0 0x7faa800bb310 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.182+0000 7faa85c16700 1 --2- 172.21.15.3:0/3402816721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa800c1fe0 0x7faa801e5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.182+0000 7faa85c16700 1 --2- 172.21.15.3:0/3402816721 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa800bf210 0x7faa800bbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.182+0000 7faa85c16700 1 -- 172.21.15.3:0/3402816721 >> 172.21.15.3:0/3402816721 conn(0x7faa800c31d0 msgr2=0x7faa800a42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:24.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.182+0000 7faa85c16700 1 -- 172.21.15.3:0/3402816721 shutdown_connections 2023-03-06T14:16:24.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.182+0000 7faa85c16700 1 -- 172.21.15.3:0/3402816721 wait complete. 2023-03-06T14:16:24.196 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-06T14:15:45.023761+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-06T14:15:51.830917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-06T14:15:56.256188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-06T14:15:57.571429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-06T14:16:00.645210+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-06T14:16:24.197 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-06T14:16:24.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.322+0000 7f5a3a183700 1 Processor -- start 2023-03-06T14:16:24.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.322+0000 7f5a3a183700 1 -- start start 2023-03-06T14:16:24.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.323+0000 7f5a3a183700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5a341491d0 0x7f5a340c05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:24.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.323+0000 7f5a3a183700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5a340c1160 0x7f5a340c2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:24.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.323+0000 7f5a3a183700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a340c29e0 con 0x7f5a340bf4f0 2023-03-06T14:16:24.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.323+0000 7f5a3a183700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a340be680 con 0x7f5a341491d0 2023-03-06T14:16:24.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.323+0000 7f5a3a183700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a341495a0 con 0x7f5a340c1160 2023-03-06T14:16:24.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.323+0000 7f5a337fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5a341491d0 0x7f5a340c05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:24.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.323+0000 7f5a32ffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f5a340bf4f0 0x7f5a340c1b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58764/0 (socket says 172.21.15.3:58764) 2023-03-06T14:16:24.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.323+0000 7f5a32ffd700 1 -- 172.21.15.3:0/1312520461 learned_addr learned my addr 172.21.15.3:0/1312520461 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:24.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.323+0000 7f5a33fff700 1 --2- 172.21.15.3:0/1312520461 >> v2:172.21.15.136:3300/0 conn(0x7f5a340c1160 0x7f5a340c2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:24.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.323+0000 7f5a337fe700 1 -- 172.21.15.3:0/1312520461 >> v2:172.21.15.136:3300/0 conn(0x7f5a340c1160 msgr2=0x7f5a340c2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:24.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.323+0000 7f5a337fe700 1 --2- 172.21.15.3:0/1312520461 >> v2:172.21.15.136:3300/0 conn(0x7f5a340c1160 0x7f5a340c2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.323+0000 7f5a337fe700 1 -- 172.21.15.3:0/1312520461 >> v1:172.21.15.3:6789/0 conn(0x7f5a340bf4f0 legacy=0x7f5a340c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:24.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.323+0000 7f5a337fe700 1 -- 172.21.15.3:0/1312520461 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3414fb60 con 0x7f5a341491d0 2023-03-06T14:16:24.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.323+0000 7f5a327fc700 1 -- 172.21.15.3:0/1312520461 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124158168 0 0) 0x7f5a340c29e0 con 0x7f5a340bf4f0 2023-03-06T14:16:24.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.324+0000 7f5a337fe700 1 --2- 172.21.15.3:0/1312520461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5a341491d0 0x7f5a340c05e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5a340bf8c0 tx=0x7f5a1c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cafd10542c8514fc server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:24.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.324+0000 7f5a327fc700 1 -- 172.21.15.3:0/1312520461 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c011830 con 0x7f5a341491d0 2023-03-06T14:16:24.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.324+0000 7f5a327fc700 1 -- 172.21.15.3:0/1312520461 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1c011990 con 0x7f5a341491d0 2023-03-06T14:16:24.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.324+0000 7f5a327fc700 1 -- 172.21.15.3:0/1312520461 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c011d20 con 0x7f5a341491d0 2023-03-06T14:16:24.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.324+0000 7f5a3a183700 1 -- 172.21.15.3:0/1312520461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5a341491d0 msgr2=0x7f5a340c05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:24.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.324+0000 7f5a3a183700 1 --2- 172.21.15.3:0/1312520461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5a341491d0 0x7f5a340c05e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5a340bf8c0 tx=0x7f5a1c009b20 comp rx=0 tx=0).stop 2023-03-06T14:16:24.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.324+0000 7f5a3a183700 1 -- 172.21.15.3:0/1312520461 shutdown_connections 2023-03-06T14:16:24.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.324+0000 7f5a3a183700 1 --2- 172.21.15.3:0/1312520461 >> v2:172.21.15.136:3300/0 conn(0x7f5a340c1160 0x7f5a340c2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.324+0000 7f5a3a183700 1 --2- 172.21.15.3:0/1312520461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5a341491d0 0x7f5a340c05e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.324+0000 7f5a3a183700 1 -- 172.21.15.3:0/1312520461 >> 172.21.15.3:0/1312520461 conn(0x7f5a3406a2d0 msgr2=0x7f5a3406a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:24.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.324+0000 7f5a3a183700 1 -- 172.21.15.3:0/1312520461 shutdown_connections 2023-03-06T14:16:24.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.324+0000 7f5a3a183700 1 -- 172.21.15.3:0/1312520461 wait complete. 2023-03-06T14:16:24.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.325+0000 7f5a3a183700 1 Processor -- start 2023-03-06T14:16:24.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.326+0000 7f5a3a183700 1 -- start start 2023-03-06T14:16:24.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.326+0000 7f5a3a183700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5a340bf4f0 0x7f5a3414a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:24.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.326+0000 7f5a3a183700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a340c1160 0x7f5a341d89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:24.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.326+0000 7f5a3a183700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5a341491d0 0x7f5a3414b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:24.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.326+0000 7f5a3a183700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a34136250 con 0x7f5a340bf4f0 2023-03-06T14:16:24.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.326+0000 7f5a3a183700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a34136d90 con 0x7f5a340c1160 2023-03-06T14:16:24.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.326+0000 7f5a3a183700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3414af00 con 0x7f5a341491d0 2023-03-06T14:16:24.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.326+0000 7f5a337fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5a340bf4f0 0x7f5a3414a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:24.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.326+0000 7f5a337fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5a340bf4f0 0x7f5a3414a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56498/0 (socket says 172.21.15.3:56498) 2023-03-06T14:16:24.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.326+0000 7f5a337fe700 1 -- 172.21.15.3:0/2144497274 learned_addr learned my addr 172.21.15.3:0/2144497274 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:24.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.327+0000 7f5a337fe700 1 -- 172.21.15.3:0/2144497274 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5a341491d0 msgr2=0x7f5a3414b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:24.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.327+0000 7f5a32ffd700 1 --2- 172.21.15.3:0/2144497274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a340c1160 0x7f5a341d89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:24.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.327+0000 7f5a337fe700 1 --2- 172.21.15.3:0/2144497274 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5a341491d0 0x7f5a3414b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.327+0000 7f5a337fe700 1 -- 172.21.15.3:0/2144497274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a340c1160 msgr2=0x7f5a341d89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:24.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.327+0000 7f5a337fe700 1 --2- 172.21.15.3:0/2144497274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a340c1160 0x7f5a341d89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.327+0000 7f5a337fe700 1 -- 172.21.15.3:0/2144497274 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1c0094a0 con 0x7f5a340bf4f0 2023-03-06T14:16:24.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.327+0000 7f5a337fe700 1 --2- 172.21.15.3:0/2144497274 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5a340bf4f0 0x7f5a3414a3e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c000c00 tx=0x7f5a1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:24.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.327+0000 7f5a2bfff700 1 -- 172.21.15.3:0/2144497274 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c0036a0 con 0x7f5a340bf4f0 2023-03-06T14:16:24.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.327+0000 7f5a2bfff700 1 -- 172.21.15.3:0/2144497274 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1c01f070 con 0x7f5a340bf4f0 2023-03-06T14:16:24.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.327+0000 7f5a3a183700 1 -- 172.21.15.3:0/2144497274 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a340bfde0 con 0x7f5a340bf4f0 2023-03-06T14:16:24.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.327+0000 7f5a2bfff700 1 -- 172.21.15.3:0/2144497274 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c003a60 con 0x7f5a340bf4f0 2023-03-06T14:16:24.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.327+0000 7f5a3a183700 1 -- 172.21.15.3:0/2144497274 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3414fe40 con 0x7f5a340bf4f0 2023-03-06T14:16:24.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.328+0000 7f5a3a183700 1 -- 172.21.15.3:0/2144497274 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a340c00c0 con 0x7f5a340bf4f0 2023-03-06T14:16:24.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.329+0000 7f5a2bfff700 1 -- 172.21.15.3:0/2144497274 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5a1c00f050 con 0x7f5a340bf4f0 2023-03-06T14:16:24.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.329+0000 7f5a2bfff700 1 --2- 172.21.15.3:0/2144497274 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f5a140682f0 0x7f5a1406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:24.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.329+0000 7f5a2bfff700 1 -- 172.21.15.3:0/2144497274 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5a1c021070 con 0x7f5a340bf4f0 2023-03-06T14:16:24.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.329+0000 7f5a32ffd700 1 --2- 172.21.15.3:0/2144497274 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f5a140682f0 0x7f5a1406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:24.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.330+0000 7f5a32ffd700 1 --2- 172.21.15.3:0/2144497274 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f5a140682f0 0x7f5a1406a7a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5a341dc480 tx=0x7f5a24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:24.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.333+0000 7f5a2bfff700 1 -- 172.21.15.3:0/2144497274 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5a1c053e70 con 0x7f5a340bf4f0 2023-03-06T14:16:24.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.526+0000 7f5a3a183700 1 -- 172.21.15.3:0/2144497274 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a3404e6e0 con 0x7f5a340bf4f0 2023-03-06T14:16:24.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.527+0000 7f5a2bfff700 1 -- 172.21.15.3:0/2144497274 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a1c02b020 con 0x7f5a340bf4f0 2023-03-06T14:16:24.529 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-03-06T14:16:24.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.529+0000 7f5a3a183700 1 -- 172.21.15.3:0/2144497274 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f5a140682f0 msgr2=0x7f5a1406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:24.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.529+0000 7f5a3a183700 1 --2- 172.21.15.3:0/2144497274 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f5a140682f0 0x7f5a1406a7a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5a341dc480 tx=0x7f5a24009040 comp rx=0 tx=0).stop 2023-03-06T14:16:24.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.529+0000 7f5a3a183700 1 -- 172.21.15.3:0/2144497274 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5a340bf4f0 msgr2=0x7f5a3414a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:24.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.529+0000 7f5a3a183700 1 --2- 172.21.15.3:0/2144497274 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5a340bf4f0 0x7f5a3414a3e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c000c00 tx=0x7f5a1c004750 comp rx=0 tx=0).stop 2023-03-06T14:16:24.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.529+0000 7f5a3a183700 1 -- 172.21.15.3:0/2144497274 shutdown_connections 2023-03-06T14:16:24.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.529+0000 7f5a3a183700 1 --2- 172.21.15.3:0/2144497274 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f5a140682f0 0x7f5a1406a7a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.529+0000 7f5a3a183700 1 --2- 172.21.15.3:0/2144497274 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5a340bf4f0 0x7f5a3414a3e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.529+0000 7f5a3a183700 1 --2- 172.21.15.3:0/2144497274 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5a341491d0 0x7f5a3414b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.529+0000 7f5a3a183700 1 --2- 172.21.15.3:0/2144497274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a340c1160 0x7f5a341d89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.529+0000 7f5a3a183700 1 -- 172.21.15.3:0/2144497274 >> 172.21.15.3:0/2144497274 conn(0x7f5a3406a2d0 msgr2=0x7f5a340c42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:24.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.529+0000 7f5a3a183700 1 -- 172.21.15.3:0/2144497274 shutdown_connections 2023-03-06T14:16:24.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.529+0000 7f5a3a183700 1 -- 172.21.15.3:0/2144497274 wait complete. 2023-03-06T14:16:24.542 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-06T14:16:24.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.670+0000 7fb090943700 1 Processor -- start 2023-03-06T14:16:24.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.670+0000 7fb090943700 1 -- start start 2023-03-06T14:16:24.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.671+0000 7fb090943700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb08c06fde0 0x7fb08c0beb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:24.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.671+0000 7fb090943700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c0c16e0 con 0x7fb08c0bf040 2023-03-06T14:16:24.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.671+0000 7fb090943700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c070670 con 0x7fb08c0c1fe0 2023-03-06T14:16:24.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.671+0000 7fb090943700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08c0c23b0 con 0x7fb08c06fde0 2023-03-06T14:16:24.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.671+0000 7fb089d9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb08c06fde0 0x7fb08c0beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:24.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.671+0000 7fb08ad9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb08c0bf040 0x7fb08c146950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58782/0 (socket says 172.21.15.3:58782) 2023-03-06T14:16:24.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.671+0000 7fb08ad9d700 1 -- 172.21.15.3:0/1755031299 learned_addr learned my addr 172.21.15.3:0/1755031299 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:24.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.671+0000 7fb089d9b700 1 -- 172.21.15.3:0/1755031299 >> v1:172.21.15.136:6789/0 conn(0x7fb08c0c1fe0 legacy=0x7fb08c0c0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:24.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.671+0000 7fb089d9b700 1 -- 172.21.15.3:0/1755031299 >> v1:172.21.15.3:6789/0 conn(0x7fb08c0bf040 legacy=0x7fb08c146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:24.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.672+0000 7fb089d9b700 1 -- 172.21.15.3:0/1755031299 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c151070 con 0x7fb08c06fde0 2023-03-06T14:16:24.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.672+0000 7fb08959a700 1 -- 172.21.15.3:0/1755031299 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321588937 0 0) 0x7fb08c0c16e0 con 0x7fb08c0bf040 2023-03-06T14:16:24.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.672+0000 7fb089d9b700 1 --2- 172.21.15.3:0/1755031299 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb08c06fde0 0x7fb08c0beb00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb080009840 tx=0x7fb080009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4706a1d0eee890 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:24.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.672+0000 7fb08959a700 1 -- 172.21.15.3:0/1755031299 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb080011830 con 0x7fb08c06fde0 2023-03-06T14:16:24.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.672+0000 7fb08959a700 1 -- 172.21.15.3:0/1755031299 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb080011990 con 0x7fb08c06fde0 2023-03-06T14:16:24.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.672+0000 7fb08959a700 1 -- 172.21.15.3:0/1755031299 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb080011d20 con 0x7fb08c06fde0 2023-03-06T14:16:24.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.672+0000 7fb090943700 1 -- 172.21.15.3:0/1755031299 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb08c06fde0 msgr2=0x7fb08c0beb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:24.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.672+0000 7fb090943700 1 --2- 172.21.15.3:0/1755031299 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb08c06fde0 0x7fb08c0beb00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb080009840 tx=0x7fb080009b50 comp rx=0 tx=0).stop 2023-03-06T14:16:24.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.672+0000 7fb090943700 1 -- 172.21.15.3:0/1755031299 shutdown_connections 2023-03-06T14:16:24.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.672+0000 7fb090943700 1 --2- 172.21.15.3:0/1755031299 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb08c06fde0 0x7fb08c0beb00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.672+0000 7fb090943700 1 -- 172.21.15.3:0/1755031299 >> 172.21.15.3:0/1755031299 conn(0x7fb08c0c31d0 msgr2=0x7fb08c0c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:24.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.672+0000 7fb090943700 1 -- 172.21.15.3:0/1755031299 shutdown_connections 2023-03-06T14:16:24.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.673+0000 7fb090943700 1 -- 172.21.15.3:0/1755031299 wait complete. 2023-03-06T14:16:24.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.674+0000 7fb090943700 1 Processor -- start 2023-03-06T14:16:24.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.674+0000 7fb090943700 1 -- start start 2023-03-06T14:16:24.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.674+0000 7fb090943700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb08c06fde0 0x7fb08c0b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:24.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.674+0000 7fb090943700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb08c0bf040 0x7fb08c0bb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:24.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.674+0000 7fb090943700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb08c0c1fe0 0x7fb08c0bcb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:24.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.674+0000 7fb090943700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c0bc700 con 0x7fb08c0c1fe0 2023-03-06T14:16:24.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.674+0000 7fb090943700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c0ba7b0 con 0x7fb08c0bf040 2023-03-06T14:16:24.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.674+0000 7fb090943700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c0b8430 con 0x7fb08c06fde0 2023-03-06T14:16:24.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.675+0000 7fb08ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb08c0c1fe0 0x7fb08c0bcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:24.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.675+0000 7fb08ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb08c0c1fe0 0x7fb08c0bcb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56516/0 (socket says 172.21.15.3:56516) 2023-03-06T14:16:24.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.675+0000 7fb08ad9d700 1 -- 172.21.15.3:0/3504805107 learned_addr learned my addr 172.21.15.3:0/3504805107 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:24.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.675+0000 7fb089d9b700 1 --2- 172.21.15.3:0/3504805107 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb08c0bf040 0x7fb08c0bb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:24.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.675+0000 7fb08a59c700 1 --2- 172.21.15.3:0/3504805107 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb08c06fde0 0x7fb08c0b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:24.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.675+0000 7fb08ad9d700 1 -- 172.21.15.3:0/3504805107 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb08c06fde0 msgr2=0x7fb08c0b7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:24.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.675+0000 7fb08ad9d700 1 --2- 172.21.15.3:0/3504805107 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb08c06fde0 0x7fb08c0b7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.675+0000 7fb08ad9d700 1 -- 172.21.15.3:0/3504805107 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb08c0bf040 msgr2=0x7fb08c0bb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:24.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.675+0000 7fb08ad9d700 1 --2- 172.21.15.3:0/3504805107 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb08c0bf040 0x7fb08c0bb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.675+0000 7fb08ad9d700 1 -- 172.21.15.3:0/3504805107 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0800094a0 con 0x7fb08c0c1fe0 2023-03-06T14:16:24.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.675+0000 7fb08ad9d700 1 --2- 172.21.15.3:0/3504805107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb08c0c1fe0 0x7fb08c0bcb50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb084002230 tx=0x7fb08400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:24.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.675+0000 7fb07affd700 1 -- 172.21.15.3:0/3504805107 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08400aac0 con 0x7fb08c0c1fe0 2023-03-06T14:16:24.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.675+0000 7fb07affd700 1 -- 172.21.15.3:0/3504805107 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08400ac40 con 0x7fb08c0c1fe0 2023-03-06T14:16:24.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.675+0000 7fb090943700 1 -- 172.21.15.3:0/3504805107 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08c0c2600 con 0x7fb08c0c1fe0 2023-03-06T14:16:24.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.675+0000 7fb07affd700 1 -- 172.21.15.3:0/3504805107 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0840070d0 con 0x7fb08c0c1fe0 2023-03-06T14:16:24.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.675+0000 7fb090943700 1 -- 172.21.15.3:0/3504805107 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08c151350 con 0x7fb08c0c1fe0 2023-03-06T14:16:24.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.676+0000 7fb090943700 1 -- 172.21.15.3:0/3504805107 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08c0bf9f0 con 0x7fb08c0c1fe0 2023-03-06T14:16:24.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.677+0000 7fb07affd700 1 -- 172.21.15.3:0/3504805107 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb08401a030 con 0x7fb08c0c1fe0 2023-03-06T14:16:24.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.677+0000 7fb07affd700 1 --2- 172.21.15.3:0/3504805107 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb06c0682f0 0x7fb06c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:24.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.677+0000 7fb07affd700 1 -- 172.21.15.3:0/3504805107 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb084085c40 con 0x7fb08c0c1fe0 2023-03-06T14:16:24.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.677+0000 7fb08a59c700 1 --2- 172.21.15.3:0/3504805107 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb06c0682f0 0x7fb06c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:24.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.678+0000 7fb08a59c700 1 --2- 172.21.15.3:0/3504805107 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb06c0682f0 0x7fb06c06a7a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb07c007fd0 tx=0x7fb07c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:24.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.681+0000 7fb07affd700 1 -- 172.21.15.3:0/3504805107 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb084052150 con 0x7fb08c0c1fe0 2023-03-06T14:16:24.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.875+0000 7fb090943700 1 -- 172.21.15.3:0/3504805107 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb08c0bc870 con 0x7fb08c0c1fe0 2023-03-06T14:16:24.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.875+0000 7fb07affd700 1 -- 172.21.15.3:0/3504805107 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb08c0bc870 con 0x7fb08c0c1fe0 2023-03-06T14:16:24.877 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 8 2023-03-06T14:16:24.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.877+0000 7fb090943700 1 -- 172.21.15.3:0/3504805107 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb06c0682f0 msgr2=0x7fb06c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:24.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.877+0000 7fb090943700 1 --2- 172.21.15.3:0/3504805107 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb06c0682f0 0x7fb06c06a7a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb07c007fd0 tx=0x7fb07c009040 comp rx=0 tx=0).stop 2023-03-06T14:16:24.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.877+0000 7fb090943700 1 -- 172.21.15.3:0/3504805107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb08c0c1fe0 msgr2=0x7fb08c0bcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:24.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.877+0000 7fb090943700 1 --2- 172.21.15.3:0/3504805107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb08c0c1fe0 0x7fb08c0bcb50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb084002230 tx=0x7fb08400cf50 comp rx=0 tx=0).stop 2023-03-06T14:16:24.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.877+0000 7fb090943700 1 -- 172.21.15.3:0/3504805107 shutdown_connections 2023-03-06T14:16:24.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.877+0000 7fb090943700 1 --2- 172.21.15.3:0/3504805107 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb06c0682f0 0x7fb06c06a7a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.877+0000 7fb090943700 1 --2- 172.21.15.3:0/3504805107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb08c0c1fe0 0x7fb08c0bcb50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.877+0000 7fb090943700 1 --2- 172.21.15.3:0/3504805107 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb08c06fde0 0x7fb08c0b7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.877+0000 7fb090943700 1 --2- 172.21.15.3:0/3504805107 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb08c0bf040 0x7fb08c0bb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:24.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.877+0000 7fb090943700 1 -- 172.21.15.3:0/3504805107 >> 172.21.15.3:0/3504805107 conn(0x7fb08c0c31d0 msgr2=0x7fb08c0c35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:24.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.877+0000 7fb090943700 1 -- 172.21.15.3:0/3504805107 shutdown_connections 2023-03-06T14:16:24.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:24.877+0000 7fb090943700 1 -- 172.21.15.3:0/3504805107 wait complete. 2023-03-06T14:16:24.891 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-06T14:16:25.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.018+0000 7fdf3344b700 1 Processor -- start 2023-03-06T14:16:25.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.018+0000 7fdf3344b700 1 -- start start 2023-03-06T14:16:25.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.019+0000 7fdf3344b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdf2c06ea70 0x7fdf2c0bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.019+0000 7fdf3344b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf2c06ee40 0x7fdf2c1490f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.019+0000 7fdf3344b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdf2c0bdd60 0x7fdf2c149630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.019+0000 7fdf3344b700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2c0b9070 con 0x7fdf2c0bdd60 2023-03-06T14:16:25.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.019+0000 7fdf3344b700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2c149b70 con 0x7fdf2c06ea70 2023-03-06T14:16:25.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.019+0000 7fdf3344b700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c14ff80 con 0x7fdf2c06ee40 2023-03-06T14:16:25.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.019+0000 7fdf319e8700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdf2c0bdd60 0x7fdf2c149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.019+0000 7fdf319e8700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdf2c0bdd60 0x7fdf2c149630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56524/0 (socket says 172.21.15.3:56524) 2023-03-06T14:16:25.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.019+0000 7fdf319e8700 1 -- 172.21.15.3:0/106754790 learned_addr learned my addr 172.21.15.3:0/106754790 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:25.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.019+0000 7fdf309e6700 1 --2- 172.21.15.3:0/106754790 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf2c06ee40 0x7fdf2c1490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.019+0000 7fdf319e8700 1 -- 172.21.15.3:0/106754790 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf2c06ee40 msgr2=0x7fdf2c1490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:25.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.019+0000 7fdf319e8700 1 --2- 172.21.15.3:0/106754790 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf2c06ee40 0x7fdf2c1490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.019+0000 7fdf311e7700 1 --2- 172.21.15.3:0/106754790 >> v2:172.21.15.136:3300/0 conn(0x7fdf2c06ea70 0x7fdf2c0bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.019+0000 7fdf319e8700 1 -- 172.21.15.3:0/106754790 >> v2:172.21.15.136:3300/0 conn(0x7fdf2c06ea70 msgr2=0x7fdf2c0bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:25.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.019+0000 7fdf319e8700 1 --2- 172.21.15.3:0/106754790 >> v2:172.21.15.136:3300/0 conn(0x7fdf2c06ea70 0x7fdf2c0bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.019+0000 7fdf319e8700 1 -- 172.21.15.3:0/106754790 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c0bcb90 con 0x7fdf2c0bdd60 2023-03-06T14:16:25.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.019+0000 7fdf309e6700 1 --2- 172.21.15.3:0/106754790 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf2c06ee40 0x7fdf2c1490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:16:25.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.019+0000 7fdf311e7700 1 --2- 172.21.15.3:0/106754790 >> v2:172.21.15.136:3300/0 conn(0x7fdf2c06ea70 0x7fdf2c0bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:16:25.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.019+0000 7fdf319e8700 1 --2- 172.21.15.3:0/106754790 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf2c0bdd60 0x7fdf2c149630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c072740 tx=0x7fdf2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e767210329b7d35d server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:25.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.020+0000 7fdf23fff700 1 -- 172.21.15.3:0/106754790 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2400e070 con 0x7fdf2c0bdd60 2023-03-06T14:16:25.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.020+0000 7fdf23fff700 1 -- 172.21.15.3:0/106754790 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2400b980 con 0x7fdf2c0bdd60 2023-03-06T14:16:25.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.020+0000 7fdf23fff700 1 -- 172.21.15.3:0/106754790 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2400bd30 con 0x7fdf2c0bdd60 2023-03-06T14:16:25.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.020+0000 7fdf3344b700 1 -- 172.21.15.3:0/106754790 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf2c0bdd60 msgr2=0x7fdf2c149630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:25.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.020+0000 7fdf3344b700 1 --2- 172.21.15.3:0/106754790 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf2c0bdd60 0x7fdf2c149630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c072740 tx=0x7fdf2400b330 comp rx=0 tx=0).stop 2023-03-06T14:16:25.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.020+0000 7fdf3344b700 1 -- 172.21.15.3:0/106754790 shutdown_connections 2023-03-06T14:16:25.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.020+0000 7fdf3344b700 1 --2- 172.21.15.3:0/106754790 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf2c0bdd60 0x7fdf2c149630 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.020+0000 7fdf3344b700 1 --2- 172.21.15.3:0/106754790 >> v2:172.21.15.136:3300/0 conn(0x7fdf2c06ea70 0x7fdf2c0bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.020+0000 7fdf3344b700 1 --2- 172.21.15.3:0/106754790 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf2c06ee40 0x7fdf2c1490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.020+0000 7fdf3344b700 1 -- 172.21.15.3:0/106754790 >> 172.21.15.3:0/106754790 conn(0x7fdf2c0c2150 msgr2=0x7fdf2c0c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:25.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.020+0000 7fdf3344b700 1 -- 172.21.15.3:0/106754790 shutdown_connections 2023-03-06T14:16:25.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.020+0000 7fdf3344b700 1 -- 172.21.15.3:0/106754790 wait complete. 2023-03-06T14:16:25.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.022+0000 7fdf3344b700 1 Processor -- start 2023-03-06T14:16:25.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.022+0000 7fdf3344b700 1 -- start start 2023-03-06T14:16:25.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf3344b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf2c06ea70 0x7fdf2c1e5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf3344b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf2c06ee40 0x7fdf2c1e7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf3344b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf2c0bdd60 0x7fdf2c0a76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf3344b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c151c50 con 0x7fdf2c06ee40 2023-03-06T14:16:25.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf3344b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c151330 con 0x7fdf2c0bdd60 2023-03-06T14:16:25.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf3344b700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c1e8870 con 0x7fdf2c06ea70 2023-03-06T14:16:25.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf309e6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf2c06ee40 0x7fdf2c1e7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf309e6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf2c06ee40 0x7fdf2c1e7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56528/0 (socket says 172.21.15.3:56528) 2023-03-06T14:16:25.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf309e6700 1 -- 172.21.15.3:0/2061973393 learned_addr learned my addr 172.21.15.3:0/2061973393 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:25.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf311e7700 1 --2- 172.21.15.3:0/2061973393 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf2c06ea70 0x7fdf2c1e5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf319e8700 1 --2- 172.21.15.3:0/2061973393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf2c0bdd60 0x7fdf2c0a76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf309e6700 1 -- 172.21.15.3:0/2061973393 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf2c06ea70 msgr2=0x7fdf2c1e5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:25.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf309e6700 1 --2- 172.21.15.3:0/2061973393 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf2c06ea70 0x7fdf2c1e5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf309e6700 1 -- 172.21.15.3:0/2061973393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf2c0bdd60 msgr2=0x7fdf2c0a76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:25.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf309e6700 1 --2- 172.21.15.3:0/2061973393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf2c0bdd60 0x7fdf2c0a76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf309e6700 1 -- 172.21.15.3:0/2061973393 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf24009b30 con 0x7fdf2c06ee40 2023-03-06T14:16:25.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf311e7700 1 --2- 172.21.15.3:0/2061973393 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf2c06ea70 0x7fdf2c1e5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:25.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf309e6700 1 --2- 172.21.15.3:0/2061973393 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf2c06ee40 0x7fdf2c1e7da0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00c750 tx=0x7fdf1c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:25.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf21ffb700 1 -- 172.21.15.3:0/2061973393 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c011800 con 0x7fdf2c06ee40 2023-03-06T14:16:25.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf21ffb700 1 -- 172.21.15.3:0/2061973393 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c011960 con 0x7fdf2c06ee40 2023-03-06T14:16:25.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.023+0000 7fdf3344b700 1 -- 172.21.15.3:0/2061973393 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf2c0bd150 con 0x7fdf2c06ee40 2023-03-06T14:16:25.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.024+0000 7fdf21ffb700 1 -- 172.21.15.3:0/2061973393 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c011cd0 con 0x7fdf2c06ee40 2023-03-06T14:16:25.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.024+0000 7fdf3344b700 1 -- 172.21.15.3:0/2061973393 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2c0bce70 con 0x7fdf2c06ee40 2023-03-06T14:16:25.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.025+0000 7fdf3344b700 1 -- 172.21.15.3:0/2061973393 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf2c150220 con 0x7fdf2c06ee40 2023-03-06T14:16:25.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.025+0000 7fdf21ffb700 1 -- 172.21.15.3:0/2061973393 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdf1c020070 con 0x7fdf2c06ee40 2023-03-06T14:16:25.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.025+0000 7fdf21ffb700 1 --2- 172.21.15.3:0/2061973393 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fdf100682f0 0x7fdf1006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.025+0000 7fdf21ffb700 1 -- 172.21.15.3:0/2061973393 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdf1c085e50 con 0x7fdf2c06ee40 2023-03-06T14:16:25.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.026+0000 7fdf311e7700 1 --2- 172.21.15.3:0/2061973393 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fdf100682f0 0x7fdf1006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.026+0000 7fdf311e7700 1 --2- 172.21.15.3:0/2061973393 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fdf100682f0 0x7fdf1006a7a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdf28006fd0 tx=0x7fdf28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:25.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.029+0000 7fdf21ffb700 1 -- 172.21.15.3:0/2061973393 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdf1c0522d0 con 0x7fdf2c06ee40 2023-03-06T14:16:25.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.225+0000 7fdf3344b700 1 -- 172.21.15.3:0/2061973393 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf2c151d90 con 0x7fdf2c06ee40 2023-03-06T14:16:25.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.225+0000 7fdf21ffb700 1 -- 172.21.15.3:0/2061973393 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdf2c151d90 con 0x7fdf2c06ee40 2023-03-06T14:16:25.227 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-03-06T14:16:25.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.228+0000 7fdf3344b700 1 -- 172.21.15.3:0/2061973393 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fdf100682f0 msgr2=0x7fdf1006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:25.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.228+0000 7fdf3344b700 1 --2- 172.21.15.3:0/2061973393 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fdf100682f0 0x7fdf1006a7a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdf28006fd0 tx=0x7fdf28008040 comp rx=0 tx=0).stop 2023-03-06T14:16:25.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.228+0000 7fdf3344b700 1 -- 172.21.15.3:0/2061973393 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf2c06ee40 msgr2=0x7fdf2c1e7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:25.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.228+0000 7fdf3344b700 1 --2- 172.21.15.3:0/2061973393 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf2c06ee40 0x7fdf2c1e7da0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00c750 tx=0x7fdf1c00ca60 comp rx=0 tx=0).stop 2023-03-06T14:16:25.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.228+0000 7fdf3344b700 1 -- 172.21.15.3:0/2061973393 shutdown_connections 2023-03-06T14:16:25.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.228+0000 7fdf3344b700 1 --2- 172.21.15.3:0/2061973393 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fdf100682f0 0x7fdf1006a7a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.228+0000 7fdf3344b700 1 --2- 172.21.15.3:0/2061973393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf2c0bdd60 0x7fdf2c0a76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.228+0000 7fdf3344b700 1 --2- 172.21.15.3:0/2061973393 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf2c06ea70 0x7fdf2c1e5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.228+0000 7fdf3344b700 1 --2- 172.21.15.3:0/2061973393 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf2c06ee40 0x7fdf2c1e7da0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.228+0000 7fdf3344b700 1 -- 172.21.15.3:0/2061973393 >> 172.21.15.3:0/2061973393 conn(0x7fdf2c0c2150 msgr2=0x7fdf2c0c1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:25.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.228+0000 7fdf3344b700 1 -- 172.21.15.3:0/2061973393 shutdown_connections 2023-03-06T14:16:25.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.228+0000 7fdf3344b700 1 -- 172.21.15.3:0/2061973393 wait complete. 2023-03-06T14:16:25.241 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-06T14:16:25.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.367+0000 7fcf9d399700 1 Processor -- start 2023-03-06T14:16:25.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.367+0000 7fcf9d399700 1 -- start start 2023-03-06T14:16:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf9d399700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcf980bf4f0 0x7fcf980c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf9d399700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf980c29e0 con 0x7fcf980c1160 2023-03-06T14:16:25.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf9d399700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9814fb60 con 0x7fcf981491d0 2023-03-06T14:16:25.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf9d399700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf980be680 con 0x7fcf980bf4f0 2023-03-06T14:16:25.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf977fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fcf980c1160 0x7fcf980c20c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58810/0 (socket says 172.21.15.3:58810) 2023-03-06T14:16:25.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf977fe700 1 -- 172.21.15.3:0/3726030847 learned_addr learned my addr 172.21.15.3:0/3726030847 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:25.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf967fc700 1 --2- 172.21.15.3:0/3726030847 >> v2:172.21.15.136:3300/0 conn(0x7fcf980bf4f0 0x7fcf980c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf95ffb700 1 -- 172.21.15.3:0/3726030847 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085943689 0 0) 0x7fcf980c29e0 con 0x7fcf980c1160 2023-03-06T14:16:25.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf95ffb700 1 -- 172.21.15.3:0/3726030847 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf800035b0 con 0x7fcf980c1160 2023-03-06T14:16:25.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf95ffb700 1 -- 172.21.15.3:0/3726030847 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2584331594 0 0) 0x7fcf800035b0 con 0x7fcf980c1160 2023-03-06T14:16:25.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf95ffb700 1 -- 172.21.15.3:0/3726030847 >> v2:172.21.15.136:3300/0 conn(0x7fcf980bf4f0 msgr2=0x7fcf980c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:25.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf95ffb700 1 --2- 172.21.15.3:0/3726030847 >> v2:172.21.15.136:3300/0 conn(0x7fcf980bf4f0 0x7fcf980c1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf95ffb700 1 -- 172.21.15.3:0/3726030847 >> v1:172.21.15.136:6789/0 conn(0x7fcf981491d0 legacy=0x7fcf980c05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:25.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf95ffb700 1 -- 172.21.15.3:0/3726030847 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9814fe40 con 0x7fcf980c1160 2023-03-06T14:16:25.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf95ffb700 1 -- 172.21.15.3:0/3726030847 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3255535284 0 0) 0x7fcf900019f0 con 0x7fcf980c1160 2023-03-06T14:16:25.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf95ffb700 1 -- 172.21.15.3:0/3726030847 >> v1:172.21.15.3:6789/0 conn(0x7fcf980c1160 legacy=0x7fcf980c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:25.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf95ffb700 1 --2- 172.21.15.3:0/3726030847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf80003a00 0x7fcf80003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf95ffb700 1 --2- 172.21.15.3:0/3726030847 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcf80004850 0x7fcf80004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf95ffb700 1 --2- 172.21.15.3:0/3726030847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf80005200 0x7fcf8000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf95ffb700 1 -- 172.21.15.3:0/3726030847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf980be680 con 0x7fcf80005200 2023-03-06T14:16:25.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf95ffb700 1 -- 172.21.15.3:0/3726030847 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8000c110 con 0x7fcf80003a00 2023-03-06T14:16:25.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf95ffb700 1 -- 172.21.15.3:0/3726030847 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8000c2d0 con 0x7fcf80004850 2023-03-06T14:16:25.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.368+0000 7fcf977fe700 1 --2- 172.21.15.3:0/3726030847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf80005200 0x7fcf8000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.369+0000 7fcf96ffd700 1 --2- 172.21.15.3:0/3726030847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf80003a00 0x7fcf80003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.369+0000 7fcf967fc700 1 --2- 172.21.15.3:0/3726030847 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcf80004850 0x7fcf80004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.369+0000 7fcf977fe700 1 -- 172.21.15.3:0/3726030847 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcf80004850 msgr2=0x7fcf80004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:25.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.369+0000 7fcf977fe700 1 --2- 172.21.15.3:0/3726030847 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcf80004850 0x7fcf80004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.369+0000 7fcf977fe700 1 -- 172.21.15.3:0/3726030847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf80003a00 msgr2=0x7fcf80003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:25.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.369+0000 7fcf977fe700 1 --2- 172.21.15.3:0/3726030847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf80003a00 0x7fcf80003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.369+0000 7fcf977fe700 1 -- 172.21.15.3:0/3726030847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf800035b0 con 0x7fcf80005200 2023-03-06T14:16:25.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.369+0000 7fcf967fc700 1 --2- 172.21.15.3:0/3726030847 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcf80004850 0x7fcf80004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:25.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.369+0000 7fcf977fe700 1 -- 172.21.15.3:0/3726030847 reap_dead start 2023-03-06T14:16:25.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.369+0000 7fcf977fe700 1 --2- 172.21.15.3:0/3726030847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf80005200 0x7fcf8000ba10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000a7f0 tx=0x7fcf80005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9bf68b8a406ddc server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:25.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.369+0000 7fcf95ffb700 1 -- 172.21.15.3:0/3726030847 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90012600 con 0x7fcf80005200 2023-03-06T14:16:25.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.369+0000 7fcf95ffb700 1 -- 172.21.15.3:0/3726030847 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf90012780 con 0x7fcf80005200 2023-03-06T14:16:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.369+0000 7fcf95ffb700 1 -- 172.21.15.3:0/3726030847 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90012b30 con 0x7fcf80005200 2023-03-06T14:16:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.369+0000 7fcf9d399700 1 -- 172.21.15.3:0/3726030847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf80005200 msgr2=0x7fcf8000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.369+0000 7fcf9d399700 1 --2- 172.21.15.3:0/3726030847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf80005200 0x7fcf8000ba10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000a7f0 tx=0x7fcf80005880 comp rx=0 tx=0).stop 2023-03-06T14:16:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.370+0000 7fcf9d399700 1 -- 172.21.15.3:0/3726030847 shutdown_connections 2023-03-06T14:16:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.370+0000 7fcf9d399700 1 --2- 172.21.15.3:0/3726030847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf80005200 0x7fcf8000ba10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.370+0000 7fcf9d399700 1 -- 172.21.15.3:0/3726030847 >> 172.21.15.3:0/3726030847 conn(0x7fcf9806a2d0 msgr2=0x7fcf9806a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.370+0000 7fcf9d399700 1 -- 172.21.15.3:0/3726030847 shutdown_connections 2023-03-06T14:16:25.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.370+0000 7fcf9d399700 1 -- 172.21.15.3:0/3726030847 wait complete. 2023-03-06T14:16:25.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.371+0000 7fcf9d399700 1 Processor -- start 2023-03-06T14:16:25.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.371+0000 7fcf9d399700 1 -- start start 2023-03-06T14:16:25.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf9d399700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf80005200 0x7fcf981e8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf9d399700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcf980bd440 0x7fcf981e5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf9d399700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf981e63d0 0x7fcf98133920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf9d399700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf981e88b0 con 0x7fcf981e63d0 2023-03-06T14:16:25.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf9d399700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf98153350 con 0x7fcf80005200 2023-03-06T14:16:25.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf9d399700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf98148aa0 con 0x7fcf980bd440 2023-03-06T14:16:25.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf977fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf981e63d0 0x7fcf98133920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf96ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf80005200 0x7fcf981e8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf977fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf981e63d0 0x7fcf98133920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56550/0 (socket says 172.21.15.3:56550) 2023-03-06T14:16:25.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf967fc700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcf980bd440 0x7fcf981e5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf977fe700 1 -- 172.21.15.3:0/1264446298 learned_addr learned my addr 172.21.15.3:0/1264446298 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:25.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf977fe700 1 -- 172.21.15.3:0/1264446298 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcf980bd440 msgr2=0x7fcf981e5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:25.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf977fe700 1 --2- 172.21.15.3:0/1264446298 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcf980bd440 0x7fcf981e5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf977fe700 1 -- 172.21.15.3:0/1264446298 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf80005200 msgr2=0x7fcf981e8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:25.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf977fe700 1 --2- 172.21.15.3:0/1264446298 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf80005200 0x7fcf981e8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf977fe700 1 -- 172.21.15.3:0/1264446298 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf980c00c0 con 0x7fcf981e63d0 2023-03-06T14:16:25.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf96ffd700 1 --2- 172.21.15.3:0/1264446298 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf80005200 0x7fcf981e8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T14:16:25.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf977fe700 1 --2- 172.21.15.3:0/1264446298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf981e63d0 0x7fcf98133920 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000a7f0 tx=0x7fcf980bf410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:25.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf7f7fe700 1 -- 172.21.15.3:0/1264446298 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9001e630 con 0x7fcf981e63d0 2023-03-06T14:16:25.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf7f7fe700 1 -- 172.21.15.3:0/1264446298 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9001e790 con 0x7fcf981e63d0 2023-03-06T14:16:25.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf9d399700 1 -- 172.21.15.3:0/1264446298 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf980bfde0 con 0x7fcf981e63d0 2023-03-06T14:16:25.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.372+0000 7fcf7f7fe700 1 -- 172.21.15.3:0/1264446298 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9001eb00 con 0x7fcf981e63d0 2023-03-06T14:16:25.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.373+0000 7fcf9d399700 1 -- 172.21.15.3:0/1264446298 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf980c05e0 con 0x7fcf981e63d0 2023-03-06T14:16:25.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.373+0000 7fcf9d399700 1 -- 172.21.15.3:0/1264446298 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf981e5ce0 con 0x7fcf981e63d0 2023-03-06T14:16:25.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.374+0000 7fcf7f7fe700 1 -- 172.21.15.3:0/1264446298 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fcf90010070 con 0x7fcf981e63d0 2023-03-06T14:16:25.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.374+0000 7fcf7f7fe700 1 --2- 172.21.15.3:0/1264446298 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fcf84068320 0x7fcf8406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.374+0000 7fcf7f7fe700 1 -- 172.21.15.3:0/1264446298 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcf90087820 con 0x7fcf981e63d0 2023-03-06T14:16:25.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.375+0000 7fcf96ffd700 1 --2- 172.21.15.3:0/1264446298 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fcf84068320 0x7fcf8406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.375+0000 7fcf96ffd700 1 --2- 172.21.15.3:0/1264446298 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fcf84068320 0x7fcf8406a7d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcf88000c00 tx=0x7fcf88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:25.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.379+0000 7fcf7f7fe700 1 -- 172.21.15.3:0/1264446298 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fcf90053d90 con 0x7fcf981e63d0 2023-03-06T14:16:25.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.571+0000 7fcf9d399700 1 -- 172.21.15.3:0/1264446298 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcf9804e6e0 con 0x7fcf981e63d0 2023-03-06T14:16:25.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.571+0000 7fcf7f7fe700 1 -- 172.21.15.3:0/1264446298 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcf900170a0 con 0x7fcf981e63d0 2023-03-06T14:16:25.573 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-03-06T14:16:25.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.573+0000 7fcf9d399700 1 -- 172.21.15.3:0/1264446298 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fcf84068320 msgr2=0x7fcf8406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:25.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.573+0000 7fcf9d399700 1 --2- 172.21.15.3:0/1264446298 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fcf84068320 0x7fcf8406a7d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcf88000c00 tx=0x7fcf88009040 comp rx=0 tx=0).stop 2023-03-06T14:16:25.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.573+0000 7fcf9d399700 1 -- 172.21.15.3:0/1264446298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf981e63d0 msgr2=0x7fcf98133920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:25.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.573+0000 7fcf9d399700 1 --2- 172.21.15.3:0/1264446298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf981e63d0 0x7fcf98133920 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000a7f0 tx=0x7fcf980bf410 comp rx=0 tx=0).stop 2023-03-06T14:16:25.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.573+0000 7fcf9d399700 1 -- 172.21.15.3:0/1264446298 shutdown_connections 2023-03-06T14:16:25.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.573+0000 7fcf9d399700 1 --2- 172.21.15.3:0/1264446298 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fcf84068320 0x7fcf8406a7d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.573+0000 7fcf9d399700 1 --2- 172.21.15.3:0/1264446298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf981e63d0 0x7fcf98133920 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.573+0000 7fcf9d399700 1 --2- 172.21.15.3:0/1264446298 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf80005200 0x7fcf981e8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.573+0000 7fcf9d399700 1 --2- 172.21.15.3:0/1264446298 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcf980bd440 0x7fcf981e5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.573+0000 7fcf9d399700 1 -- 172.21.15.3:0/1264446298 >> 172.21.15.3:0/1264446298 conn(0x7fcf9806a2d0 msgr2=0x7fcf9814d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:25.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.573+0000 7fcf9d399700 1 -- 172.21.15.3:0/1264446298 shutdown_connections 2023-03-06T14:16:25.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.574+0000 7fcf9d399700 1 -- 172.21.15.3:0/1264446298 wait complete. 2023-03-06T14:16:25.587 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-06T14:16:25.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.713+0000 7f030b235700 1 Processor -- start 2023-03-06T14:16:25.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.713+0000 7f030b235700 1 -- start start 2023-03-06T14:16:25.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.714+0000 7f030b235700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0304146d40 0x7f03041507d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.714+0000 7f030b235700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f03041471e0 0x7f0304150d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.714+0000 7f030b235700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03040a3260 con 0x7f030406b430 2023-03-06T14:16:25.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.714+0000 7f030b235700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030406efe0 con 0x7f0304146d40 2023-03-06T14:16:25.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.714+0000 7f030b235700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030406bf10 con 0x7f03041471e0 2023-03-06T14:16:25.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.714+0000 7f0303fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0304146d40 0x7f03041507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.714+0000 7f0308fd1700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f030406b430 0x7f030406b800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58826/0 (socket says 172.21.15.3:58826) 2023-03-06T14:16:25.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.714+0000 7f0303fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0304146d40 0x7f03041507d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56556/0 (socket says 172.21.15.3:56556) 2023-03-06T14:16:25.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.714+0000 7f0308fd1700 1 -- 172.21.15.3:0/1067985168 learned_addr learned my addr 172.21.15.3:0/1067985168 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:25.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.714+0000 7f03097d2700 1 --2- 172.21.15.3:0/1067985168 >> v2:172.21.15.136:3300/0 conn(0x7f03041471e0 0x7f0304150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.714+0000 7f0303fff700 1 -- 172.21.15.3:0/1067985168 >> v2:172.21.15.136:3300/0 conn(0x7f03041471e0 msgr2=0x7f0304150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:25.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.714+0000 7f0303fff700 1 --2- 172.21.15.3:0/1067985168 >> v2:172.21.15.136:3300/0 conn(0x7f03041471e0 0x7f0304150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.714+0000 7f0303fff700 1 -- 172.21.15.3:0/1067985168 >> v1:172.21.15.3:6789/0 conn(0x7f030406b430 legacy=0x7f030406b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:25.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.714+0000 7f0303fff700 1 -- 172.21.15.3:0/1067985168 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030414dbf0 con 0x7f0304146d40 2023-03-06T14:16:25.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.714+0000 7f03037fe700 1 -- 172.21.15.3:0/1067985168 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239974771 0 0) 0x7f02f8001110 con 0x7f030406b430 2023-03-06T14:16:25.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.714+0000 7f0303fff700 1 --2- 172.21.15.3:0/1067985168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0304146d40 0x7f03041507d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f030406a8b0 tx=0x7f02f0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa59c12e2bcf1d39 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:25.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.715+0000 7f03037fe700 1 -- 172.21.15.3:0/1067985168 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f0011830 con 0x7f0304146d40 2023-03-06T14:16:25.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.715+0000 7f03037fe700 1 -- 172.21.15.3:0/1067985168 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f0011990 con 0x7f0304146d40 2023-03-06T14:16:25.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.715+0000 7f03037fe700 1 -- 172.21.15.3:0/1067985168 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f0011d20 con 0x7f0304146d40 2023-03-06T14:16:25.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.715+0000 7f030b235700 1 -- 172.21.15.3:0/1067985168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0304146d40 msgr2=0x7f03041507d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:25.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.715+0000 7f030b235700 1 --2- 172.21.15.3:0/1067985168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0304146d40 0x7f03041507d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f030406a8b0 tx=0x7f02f0009b20 comp rx=0 tx=0).stop 2023-03-06T14:16:25.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.715+0000 7f030b235700 1 -- 172.21.15.3:0/1067985168 shutdown_connections 2023-03-06T14:16:25.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.715+0000 7f030b235700 1 --2- 172.21.15.3:0/1067985168 >> v2:172.21.15.136:3300/0 conn(0x7f03041471e0 0x7f0304150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.715+0000 7f030b235700 1 --2- 172.21.15.3:0/1067985168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0304146d40 0x7f03041507d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.715+0000 7f030b235700 1 -- 172.21.15.3:0/1067985168 >> 172.21.15.3:0/1067985168 conn(0x7f03040c17d0 msgr2=0x7f03040c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:25.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.715+0000 7f030b235700 1 -- 172.21.15.3:0/1067985168 shutdown_connections 2023-03-06T14:16:25.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.715+0000 7f030b235700 1 -- 172.21.15.3:0/1067985168 wait complete. 2023-03-06T14:16:25.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.716+0000 7f030b235700 1 Processor -- start 2023-03-06T14:16:25.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.716+0000 7f030b235700 1 -- start start 2023-03-06T14:16:25.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.717+0000 7f030b235700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f030406b430 0x7f03041e5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.717+0000 7f030b235700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0304146d40 0x7f03040bb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.717+0000 7f030b235700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f03041471e0 0x7f03040ba230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.717+0000 7f030b235700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03040b8d50 con 0x7f030406b430 2023-03-06T14:16:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.717+0000 7f030b235700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03040b9da0 con 0x7f0304146d40 2023-03-06T14:16:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.717+0000 7f030b235700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03041e6510 con 0x7f03041471e0 2023-03-06T14:16:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.717+0000 7f0308fd1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f030406b430 0x7f03041e5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.717+0000 7f0308fd1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f030406b430 0x7f03041e5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56560/0 (socket says 172.21.15.3:56560) 2023-03-06T14:16:25.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.717+0000 7f0308fd1700 1 -- 172.21.15.3:0/832541141 learned_addr learned my addr 172.21.15.3:0/832541141 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:25.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.717+0000 7f0303fff700 1 --2- 172.21.15.3:0/832541141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0304146d40 0x7f03040bb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.717+0000 7f03097d2700 1 --2- 172.21.15.3:0/832541141 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f03041471e0 0x7f03040ba230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.718+0000 7f0308fd1700 1 -- 172.21.15.3:0/832541141 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f03041471e0 msgr2=0x7f03040ba230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:25.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.718+0000 7f0308fd1700 1 --2- 172.21.15.3:0/832541141 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f03041471e0 0x7f03040ba230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.718+0000 7f0308fd1700 1 -- 172.21.15.3:0/832541141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0304146d40 msgr2=0x7f03040bb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:25.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.718+0000 7f0308fd1700 1 --2- 172.21.15.3:0/832541141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0304146d40 0x7f03040bb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.718+0000 7f0308fd1700 1 -- 172.21.15.3:0/832541141 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f00094a0 con 0x7f030406b430 2023-03-06T14:16:25.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.718+0000 7f0308fd1700 1 --2- 172.21.15.3:0/832541141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f030406b430 0x7f03041e5fd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f02f800c580 tx=0x7f02f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:25.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.718+0000 7f03017fa700 1 -- 172.21.15.3:0/832541141 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8004c80 con 0x7f030406b430 2023-03-06T14:16:25.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.718+0000 7f03017fa700 1 -- 172.21.15.3:0/832541141 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f8015070 con 0x7f030406b430 2023-03-06T14:16:25.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.718+0000 7f030b235700 1 -- 172.21.15.3:0/832541141 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f030406f4d0 con 0x7f030406b430 2023-03-06T14:16:25.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.718+0000 7f03017fa700 1 -- 172.21.15.3:0/832541141 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f80070d0 con 0x7f030406b430 2023-03-06T14:16:25.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.718+0000 7f030b235700 1 -- 172.21.15.3:0/832541141 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030406f1f0 con 0x7f030406b430 2023-03-06T14:16:25.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.719+0000 7f030b235700 1 -- 172.21.15.3:0/832541141 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030414d880 con 0x7f030406b430 2023-03-06T14:16:25.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.719+0000 7f03017fa700 1 -- 172.21.15.3:0/832541141 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f02f8022070 con 0x7f030406b430 2023-03-06T14:16:25.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.720+0000 7f03017fa700 1 --2- 172.21.15.3:0/832541141 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f02e8068320 0x7f02e806a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:25.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.720+0000 7f03017fa700 1 -- 172.21.15.3:0/832541141 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f02f8089490 con 0x7f030406b430 2023-03-06T14:16:25.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.720+0000 7f0303fff700 1 --2- 172.21.15.3:0/832541141 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f02e8068320 0x7f02e806a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:25.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.720+0000 7f0303fff700 1 --2- 172.21.15.3:0/832541141 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f02e8068320 0x7f02e806a7d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f02f00090b0 tx=0x7f02f001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:25.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.724+0000 7f03017fa700 1 -- 172.21.15.3:0/832541141 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f02f8055a00 con 0x7f030406b430 2023-03-06T14:16:25.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.916+0000 7f030b235700 1 -- 172.21.15.3:0/832541141 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f03040ba080 con 0x7f030406b430 2023-03-06T14:16:25.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.917+0000 7f03017fa700 1 -- 172.21.15.3:0/832541141 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f02f80200a0 con 0x7f030406b430 2023-03-06T14:16:25.919 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-03-06T14:16:25.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.919+0000 7f030b235700 1 -- 172.21.15.3:0/832541141 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f02e8068320 msgr2=0x7f02e806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:25.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.919+0000 7f030b235700 1 --2- 172.21.15.3:0/832541141 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f02e8068320 0x7f02e806a7d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f02f00090b0 tx=0x7f02f001c040 comp rx=0 tx=0).stop 2023-03-06T14:16:25.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.919+0000 7f030b235700 1 -- 172.21.15.3:0/832541141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f030406b430 msgr2=0x7f03041e5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:25.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.919+0000 7f030b235700 1 --2- 172.21.15.3:0/832541141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f030406b430 0x7f03041e5fd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f02f800c580 tx=0x7f02f800c940 comp rx=0 tx=0).stop 2023-03-06T14:16:25.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.919+0000 7f030b235700 1 -- 172.21.15.3:0/832541141 shutdown_connections 2023-03-06T14:16:25.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.919+0000 7f030b235700 1 --2- 172.21.15.3:0/832541141 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f02e8068320 0x7f02e806a7d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.919+0000 7f030b235700 1 --2- 172.21.15.3:0/832541141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f030406b430 0x7f03041e5fd0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.919+0000 7f030b235700 1 --2- 172.21.15.3:0/832541141 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f03041471e0 0x7f03040ba230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.919+0000 7f030b235700 1 --2- 172.21.15.3:0/832541141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0304146d40 0x7f03040bb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:25.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.919+0000 7f030b235700 1 -- 172.21.15.3:0/832541141 >> 172.21.15.3:0/832541141 conn(0x7f03040c17d0 msgr2=0x7f03040c1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:25.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.919+0000 7f030b235700 1 -- 172.21.15.3:0/832541141 shutdown_connections 2023-03-06T14:16:25.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:25.919+0000 7f030b235700 1 -- 172.21.15.3:0/832541141 wait complete. 2023-03-06T14:16:25.933 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-06T14:16:26.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.055+0000 7fb5f765c700 1 Processor -- start 2023-03-06T14:16:26.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.056+0000 7fb5f765c700 1 -- start start 2023-03-06T14:16:26.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.056+0000 7fb5f765c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5f00c1f50 0x7fb5f00c2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.056+0000 7fb5f765c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb5f00c0e00 0x7fb5f0149250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.056+0000 7fb5f765c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f00c13d0 con 0x7fb5f0148de0 2023-03-06T14:16:26.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.056+0000 7fb5f765c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f014f4c0 con 0x7fb5f00c0e00 2023-03-06T14:16:26.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.056+0000 7fb5f765c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f00c02d0 con 0x7fb5f00c1f50 2023-03-06T14:16:26.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.057+0000 7fb5f5bf9700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb5f00c0e00 0x7fb5f0149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.057+0000 7fb5f4bf7700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb5f0148de0 0x7fb5f00c06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58842/0 (socket says 172.21.15.3:58842) 2023-03-06T14:16:26.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.057+0000 7fb5f4bf7700 1 -- 172.21.15.3:0/2652980236 learned_addr learned my addr 172.21.15.3:0/2652980236 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-03-06T14:16:26.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.057+0000 7fb5f5bf9700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb5f00c0e00 0x7fb5f0149250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56572/0 (socket says 172.21.15.3:56572) 2023-03-06T14:16:26.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.057+0000 7fb5f53f8700 1 --2- 172.21.15.3:0/2652980236 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5f00c1f50 0x7fb5f00c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.057+0000 7fb5f5bf9700 1 -- 172.21.15.3:0/2652980236 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5f00c1f50 msgr2=0x7fb5f00c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:26.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.057+0000 7fb5f5bf9700 1 --2- 172.21.15.3:0/2652980236 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5f00c1f50 0x7fb5f00c2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.057+0000 7fb5f5bf9700 1 -- 172.21.15.3:0/2652980236 >> v1:172.21.15.3:6789/0 conn(0x7fb5f0148de0 legacy=0x7fb5f00c06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:26.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.057+0000 7fb5e7fff700 1 -- 172.21.15.3:0/2652980236 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628264210 0 0) 0x7fb5f00c13d0 con 0x7fb5f0148de0 2023-03-06T14:16:26.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.057+0000 7fb5f5bf9700 1 -- 172.21.15.3:0/2652980236 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f00c1670 con 0x7fb5f00c0e00 2023-03-06T14:16:26.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.057+0000 7fb5f5bf9700 1 --2- 172.21.15.3:0/2652980236 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5f00c0e00 0x7fb5f0149250 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8009d90 tx=0x7fb5e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4a22c6533f613 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:26.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.057+0000 7fb5e7fff700 1 -- 172.21.15.3:0/2652980236 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e800e070 con 0x7fb5f00c0e00 2023-03-06T14:16:26.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.057+0000 7fb5e7fff700 1 -- 172.21.15.3:0/2652980236 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e800bbd0 con 0x7fb5f00c0e00 2023-03-06T14:16:26.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.057+0000 7fb5e7fff700 1 -- 172.21.15.3:0/2652980236 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8012430 con 0x7fb5f00c0e00 2023-03-06T14:16:26.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.058+0000 7fb5f765c700 1 -- 172.21.15.3:0/2652980236 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5f00c0e00 msgr2=0x7fb5f0149250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:26.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.058+0000 7fb5f765c700 1 --2- 172.21.15.3:0/2652980236 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5f00c0e00 0x7fb5f0149250 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8009d90 tx=0x7fb5e800b330 comp rx=0 tx=0).stop 2023-03-06T14:16:26.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.058+0000 7fb5f765c700 1 -- 172.21.15.3:0/2652980236 shutdown_connections 2023-03-06T14:16:26.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.058+0000 7fb5f765c700 1 --2- 172.21.15.3:0/2652980236 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5f00c0e00 0x7fb5f0149250 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.058+0000 7fb5f765c700 1 --2- 172.21.15.3:0/2652980236 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5f00c1f50 0x7fb5f00c2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.058+0000 7fb5f765c700 1 -- 172.21.15.3:0/2652980236 >> 172.21.15.3:0/2652980236 conn(0x7fb5f006a2d0 msgr2=0x7fb5f006a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:26.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.058+0000 7fb5f765c700 1 -- 172.21.15.3:0/2652980236 shutdown_connections 2023-03-06T14:16:26.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.058+0000 7fb5f765c700 1 -- 172.21.15.3:0/2652980236 wait complete. 2023-03-06T14:16:26.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.059+0000 7fb5f765c700 1 Processor -- start 2023-03-06T14:16:26.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.059+0000 7fb5f765c700 1 -- start start 2023-03-06T14:16:26.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.060+0000 7fb5f765c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5f00c0e00 0x7fb5f01e4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.060+0000 7fb5f765c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5f00c1f50 0x7fb5f014bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.060+0000 7fb5f765c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5f0148de0 0x7fb5f00c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.060+0000 7fb5f765c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f01e4c70 con 0x7fb5f0148de0 2023-03-06T14:16:26.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.060+0000 7fb5f765c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f014c530 con 0x7fb5f00c1f50 2023-03-06T14:16:26.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.060+0000 7fb5f765c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f00b8160 con 0x7fb5f00c0e00 2023-03-06T14:16:26.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.060+0000 7fb5f5bf9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5f0148de0 0x7fb5f00c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.060+0000 7fb5f5bf9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5f0148de0 0x7fb5f00c49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56576/0 (socket says 172.21.15.3:56576) 2023-03-06T14:16:26.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.060+0000 7fb5f5bf9700 1 -- 172.21.15.3:0/3100498383 learned_addr learned my addr 172.21.15.3:0/3100498383 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:26.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.060+0000 7fb5f53f8700 1 --2- 172.21.15.3:0/3100498383 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5f00c0e00 0x7fb5f01e4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.060+0000 7fb5f4bf7700 1 --2- 172.21.15.3:0/3100498383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5f00c1f50 0x7fb5f014bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.060+0000 7fb5f5bf9700 1 -- 172.21.15.3:0/3100498383 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5f00c0e00 msgr2=0x7fb5f01e4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:26.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.060+0000 7fb5f5bf9700 1 --2- 172.21.15.3:0/3100498383 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5f00c0e00 0x7fb5f01e4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.060+0000 7fb5f5bf9700 1 -- 172.21.15.3:0/3100498383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5f00c1f50 msgr2=0x7fb5f014bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:26.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.060+0000 7fb5f5bf9700 1 --2- 172.21.15.3:0/3100498383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5f00c1f50 0x7fb5f014bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.060+0000 7fb5f5bf9700 1 -- 172.21.15.3:0/3100498383 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e8009a70 con 0x7fb5f0148de0 2023-03-06T14:16:26.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.060+0000 7fb5f4bf7700 1 --2- 172.21.15.3:0/3100498383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5f00c1f50 0x7fb5f014bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:26.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.060+0000 7fb5f5bf9700 1 --2- 172.21.15.3:0/3100498383 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5f0148de0 0x7fb5f00c49e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8013000 tx=0x7fb5e8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:26.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.061+0000 7fb5e5ffb700 1 -- 172.21.15.3:0/3100498383 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8012430 con 0x7fb5f0148de0 2023-03-06T14:16:26.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.061+0000 7fb5e5ffb700 1 -- 172.21.15.3:0/3100498383 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e8020070 con 0x7fb5f0148de0 2023-03-06T14:16:26.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.061+0000 7fb5f765c700 1 -- 172.21.15.3:0/3100498383 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f00bfef0 con 0x7fb5f0148de0 2023-03-06T14:16:26.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.061+0000 7fb5e5ffb700 1 -- 172.21.15.3:0/3100498383 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8004280 con 0x7fb5f0148de0 2023-03-06T14:16:26.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.061+0000 7fb5f765c700 1 -- 172.21.15.3:0/3100498383 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f014f1e0 con 0x7fb5f0148de0 2023-03-06T14:16:26.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.062+0000 7fb5f765c700 1 -- 172.21.15.3:0/3100498383 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f00bf720 con 0x7fb5f0148de0 2023-03-06T14:16:26.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.062+0000 7fb5e5ffb700 1 -- 172.21.15.3:0/3100498383 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb5e80043e0 con 0x7fb5f0148de0 2023-03-06T14:16:26.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.063+0000 7fb5e5ffb700 1 --2- 172.21.15.3:0/3100498383 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb5d40682f0 0x7fb5d406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.063+0000 7fb5e5ffb700 1 -- 172.21.15.3:0/3100498383 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb5e8022070 con 0x7fb5f0148de0 2023-03-06T14:16:26.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.063+0000 7fb5f53f8700 1 --2- 172.21.15.3:0/3100498383 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb5d40682f0 0x7fb5d406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.063+0000 7fb5f53f8700 1 --2- 172.21.15.3:0/3100498383 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb5d40682f0 0x7fb5d406a7a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec006b20 tx=0x7fb5ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:26.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.067+0000 7fb5e5ffb700 1 -- 172.21.15.3:0/3100498383 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb5e8054c70 con 0x7fb5f0148de0 2023-03-06T14:16:26.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.304+0000 7fb5f765c700 1 -- 172.21.15.3:0/3100498383 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5f00675f0 con 0x7fb5f0148de0 2023-03-06T14:16:26.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.305+0000 7fb5e5ffb700 1 -- 172.21.15.3:0/3100498383 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4644 (secure 0 0 0) 0x7fb5e8025380 con 0x7fb5f0148de0 2023-03-06T14:16:26.307 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-03-06T14:16:26.307 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/3666647721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3666647721},{"type":"v1","addr":"172.21.15.136:6835","nonce":3666647721}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6834/1347040159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":1347040159},{"type":"v1","addr":"172.21.15.3:6834","nonce":1347040159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2387644382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2387644382},{"type":"v1","addr":"172.21.15.136:6837","nonce":2387644382}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-06T14:15:58.597248+0000","modified":"2023-03-06T14:16:17.169107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6835/3655666630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6833","nonce":3655666630},{"type":"v1","addr":"172.21.15.3:6835","nonce":3655666630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-06T14:16:26.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.307+0000 7fb5f765c700 1 -- 172.21.15.3:0/3100498383 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb5d40682f0 msgr2=0x7fb5d406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:26.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.307+0000 7fb5f765c700 1 --2- 172.21.15.3:0/3100498383 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb5d40682f0 0x7fb5d406a7a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec006b20 tx=0x7fb5ec008040 comp rx=0 tx=0).stop 2023-03-06T14:16:26.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.307+0000 7fb5f765c700 1 -- 172.21.15.3:0/3100498383 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5f0148de0 msgr2=0x7fb5f00c49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:26.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.307+0000 7fb5f765c700 1 --2- 172.21.15.3:0/3100498383 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5f0148de0 0x7fb5f00c49e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8013000 tx=0x7fb5e8004ad0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.307+0000 7fb5f765c700 1 -- 172.21.15.3:0/3100498383 shutdown_connections 2023-03-06T14:16:26.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.307+0000 7fb5f765c700 1 --2- 172.21.15.3:0/3100498383 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7fb5d40682f0 0x7fb5d406a7a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.307+0000 7fb5f765c700 1 --2- 172.21.15.3:0/3100498383 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5f0148de0 0x7fb5f00c49e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.307+0000 7fb5f765c700 1 --2- 172.21.15.3:0/3100498383 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5f00c0e00 0x7fb5f01e4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.307+0000 7fb5f765c700 1 --2- 172.21.15.3:0/3100498383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5f00c1f50 0x7fb5f014bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.307+0000 7fb5f765c700 1 -- 172.21.15.3:0/3100498383 >> 172.21.15.3:0/3100498383 conn(0x7fb5f006a2d0 msgr2=0x7fb5f00c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:26.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.307+0000 7fb5f765c700 1 -- 172.21.15.3:0/3100498383 shutdown_connections 2023-03-06T14:16:26.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.307+0000 7fb5f765c700 1 -- 172.21.15.3:0/3100498383 wait complete. 2023-03-06T14:16:26.310 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 9 2023-03-06T14:16:26.722 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-03-06T14:15:58.597248+0000', 'modified': '2023-03-06T14:16:17.169107+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.3:6835/3655666630', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.3:6833', 'nonce': 3655666630}, {'type': 'v1', 'addr': '172.21.15.3:6835', 'nonce': 3655666630}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-03-06T14:16:26.723 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-03-06T14:16:26.723 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-03-06T14:16:26.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.851+0000 7f3deea0f700 1 Processor -- start 2023-03-06T14:16:26.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.851+0000 7f3deea0f700 1 -- start start 2023-03-06T14:16:26.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.852+0000 7f3deea0f700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3de806ea70 0x7f3de80bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.852+0000 7f3deea0f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3de80bdd60 0x7f3de806c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.852+0000 7f3deea0f700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de814ff80 con 0x7f3de806ee40 2023-03-06T14:16:26.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.852+0000 7f3deea0f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de80b9070 con 0x7f3de80bdd60 2023-03-06T14:16:26.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.852+0000 7f3deea0f700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de80bcb90 con 0x7f3de806ea70 2023-03-06T14:16:26.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.852+0000 7f3decfac700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3de80bdd60 0x7f3de806c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.852+0000 7f3decfac700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3de80bdd60 0x7f3de806c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56586/0 (socket says 172.21.15.3:56586) 2023-03-06T14:16:26.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.852+0000 7f3decfac700 1 -- 172.21.15.3:0/2978086175 learned_addr learned my addr 172.21.15.3:0/2978086175 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:26.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.853+0000 7f3de7fff700 1 --2- 172.21.15.3:0/2978086175 >> v2:172.21.15.136:3300/0 conn(0x7f3de806ea70 0x7f3de80bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.853+0000 7f3decfac700 1 -- 172.21.15.3:0/2978086175 >> v2:172.21.15.136:3300/0 conn(0x7f3de806ea70 msgr2=0x7f3de80bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:26.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.853+0000 7f3decfac700 1 --2- 172.21.15.3:0/2978086175 >> v2:172.21.15.136:3300/0 conn(0x7f3de806ea70 0x7f3de80bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.853+0000 7f3decfac700 1 -- 172.21.15.3:0/2978086175 >> v1:172.21.15.136:6789/0 conn(0x7f3de806ee40 legacy=0x7f3de81490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:26.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.853+0000 7f3decfac700 1 -- 172.21.15.3:0/2978086175 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de80bce70 con 0x7f3de80bdd60 2023-03-06T14:16:26.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.853+0000 7f3decfac700 1 --2- 172.21.15.3:0/2978086175 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de80bdd60 0x7f3de806c8a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3de8072740 tx=0x7f3de000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4473b2ed7e028df7 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:26.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.853+0000 7f3de6ffd700 1 -- 172.21.15.3:0/2978086175 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de000e070 con 0x7f3de80bdd60 2023-03-06T14:16:26.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.853+0000 7f3de6ffd700 1 -- 172.21.15.3:0/2978086175 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de0003a20 con 0x7f3de80bdd60 2023-03-06T14:16:26.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.853+0000 7f3de6ffd700 1 -- 172.21.15.3:0/2978086175 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0003dd0 con 0x7f3de80bdd60 2023-03-06T14:16:26.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.853+0000 7f3deea0f700 1 -- 172.21.15.3:0/2978086175 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de80bdd60 msgr2=0x7f3de806c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:26.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.853+0000 7f3deea0f700 1 --2- 172.21.15.3:0/2978086175 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de80bdd60 0x7f3de806c8a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3de8072740 tx=0x7f3de000b330 comp rx=0 tx=0).stop 2023-03-06T14:16:26.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.854+0000 7f3deea0f700 1 -- 172.21.15.3:0/2978086175 shutdown_connections 2023-03-06T14:16:26.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.854+0000 7f3deea0f700 1 --2- 172.21.15.3:0/2978086175 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de80bdd60 0x7f3de806c8a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.854+0000 7f3deea0f700 1 --2- 172.21.15.3:0/2978086175 >> v2:172.21.15.136:3300/0 conn(0x7f3de806ea70 0x7f3de80bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.854+0000 7f3deea0f700 1 -- 172.21.15.3:0/2978086175 >> 172.21.15.3:0/2978086175 conn(0x7f3de80c2150 msgr2=0x7f3de80c2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:26.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.854+0000 7f3deea0f700 1 -- 172.21.15.3:0/2978086175 shutdown_connections 2023-03-06T14:16:26.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.854+0000 7f3deea0f700 1 -- 172.21.15.3:0/2978086175 wait complete. 2023-03-06T14:16:26.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.855+0000 7f3deea0f700 1 Processor -- start 2023-03-06T14:16:26.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.855+0000 7f3deea0f700 1 -- start start 2023-03-06T14:16:26.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.855+0000 7f3deea0f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3de806ea70 0x7f3de8152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.855+0000 7f3deea0f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de806ee40 0x7f3de8148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.855+0000 7f3deea0f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3de80bdd60 0x7f3de8148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.855+0000 7f3deea0f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de80a5d90 con 0x7f3de806ee40 2023-03-06T14:16:26.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.855+0000 7f3deea0f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de81e44a0 con 0x7f3de806ea70 2023-03-06T14:16:26.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.855+0000 7f3deea0f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de81530c0 con 0x7f3de80bdd60 2023-03-06T14:16:26.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.856+0000 7f3de77fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de806ee40 0x7f3de8148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.856+0000 7f3de77fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de806ee40 0x7f3de8148030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56592/0 (socket says 172.21.15.3:56592) 2023-03-06T14:16:26.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.856+0000 7f3de7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3de806ea70 0x7f3de8152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.856+0000 7f3de77fe700 1 -- 172.21.15.3:0/1065606851 learned_addr learned my addr 172.21.15.3:0/1065606851 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:26.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.856+0000 7f3decfac700 1 --2- 172.21.15.3:0/1065606851 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3de80bdd60 0x7f3de8148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.856+0000 7f3de77fe700 1 -- 172.21.15.3:0/1065606851 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3de80bdd60 msgr2=0x7f3de8148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:26.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.856+0000 7f3de77fe700 1 --2- 172.21.15.3:0/1065606851 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3de80bdd60 0x7f3de8148570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.856+0000 7f3de77fe700 1 -- 172.21.15.3:0/1065606851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3de806ea70 msgr2=0x7f3de8152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:26.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.856+0000 7f3de77fe700 1 --2- 172.21.15.3:0/1065606851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3de806ea70 0x7f3de8152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.856+0000 7f3de77fe700 1 -- 172.21.15.3:0/1065606851 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de0009b30 con 0x7f3de806ee40 2023-03-06T14:16:26.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.856+0000 7f3de77fe700 1 --2- 172.21.15.3:0/1065606851 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de806ee40 0x7f3de8148030 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800c500 tx=0x7f3dd800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:26.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.856+0000 7f3de4ff9700 1 -- 172.21.15.3:0/1065606851 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8011790 con 0x7f3de806ee40 2023-03-06T14:16:26.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.856+0000 7f3de4ff9700 1 -- 172.21.15.3:0/1065606851 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd80118f0 con 0x7f3de806ee40 2023-03-06T14:16:26.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.856+0000 7f3deea0f700 1 -- 172.21.15.3:0/1065606851 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de8150220 con 0x7f3de806ee40 2023-03-06T14:16:26.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.856+0000 7f3de4ff9700 1 -- 172.21.15.3:0/1065606851 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8011ca0 con 0x7f3de806ee40 2023-03-06T14:16:26.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.856+0000 7f3deea0f700 1 -- 172.21.15.3:0/1065606851 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de80bd150 con 0x7f3de806ee40 2023-03-06T14:16:26.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.858+0000 7f3de4ff9700 1 -- 172.21.15.3:0/1065606851 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3dd8010050 con 0x7f3de806ee40 2023-03-06T14:16:26.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.858+0000 7f3de4ff9700 1 --2- 172.21.15.3:0/1065606851 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3dd40682f0 0x7f3dd406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.858+0000 7f3de4ff9700 1 -- 172.21.15.3:0/1065606851 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3dd8085c10 con 0x7f3de806ee40 2023-03-06T14:16:26.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.858+0000 7f3de7fff700 1 --2- 172.21.15.3:0/1065606851 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3dd40682f0 0x7f3dd406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.859+0000 7f3de7fff700 1 --2- 172.21.15.3:0/1065606851 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3dd40682f0 0x7f3dd406a7a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3de80a81e0 tx=0x7f3ddc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:26.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.860+0000 7f3dfab98b80 1 Processor -- start 2023-03-06T14:16:26.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.860+0000 7f3dfab98b80 1 -- start start 2023-03-06T14:16:26.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.861+0000 7f3dfab98b80 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25b7ad0 0x561ec25b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.861+0000 7f3dfab98b80 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25bd410 0x561ec25bb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.861+0000 7f3dfab98b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25bb570 0x561ec25d7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.861+0000 7f3dfab98b80 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ec24a6bc0 con 0x561ec25b7ad0 2023-03-06T14:16:26.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.861+0000 7f3dfab98b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ec2515350 con 0x561ec25bb570 2023-03-06T14:16:26.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.861+0000 7f3dfab98b80 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ec250e880 con 0x561ec25bd410 2023-03-06T14:16:26.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.861+0000 7f3de7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25b7ad0 0x561ec25b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.861+0000 7f3de7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25b7ad0 0x561ec25b7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56596/0 (socket says 172.21.15.3:56596) 2023-03-06T14:16:26.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.861+0000 7f3de7fff700 1 -- 172.21.15.3:0/2653442425 learned_addr learned my addr 172.21.15.3:0/2653442425 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:26.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.861+0000 7f3de77fe700 1 --2- 172.21.15.3:0/2653442425 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25bd410 0x561ec25bb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.861+0000 7f3decfac700 1 --2- 172.21.15.3:0/2653442425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25bb570 0x561ec25d7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.861+0000 7f3de7fff700 1 -- 172.21.15.3:0/2653442425 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25bd410 msgr2=0x561ec25bb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:26.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.861+0000 7f3de7fff700 1 --2- 172.21.15.3:0/2653442425 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25bd410 0x561ec25bb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.861+0000 7f3de7fff700 1 -- 172.21.15.3:0/2653442425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25bb570 msgr2=0x561ec25d7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:26.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.861+0000 7f3de7fff700 1 --2- 172.21.15.3:0/2653442425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25bb570 0x561ec25d7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.861+0000 7f3de7fff700 1 -- 172.21.15.3:0/2653442425 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ec23905e0 con 0x561ec25b7ad0 2023-03-06T14:16:26.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.861+0000 7f3decfac700 1 --2- 172.21.15.3:0/2653442425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25bb570 0x561ec25d7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:26.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.861+0000 7f3de7fff700 1 --2- 172.21.15.3:0/2653442425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25b7ad0 0x561ec25b7ea0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc005c50 tx=0x7f3ddc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5121f87fd63726b server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:26.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.862+0000 7f3dcdffb700 1 -- 172.21.15.3:0/2653442425 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc010db0 con 0x561ec25b7ad0 2023-03-06T14:16:26.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.862+0000 7f3dcdffb700 1 -- 172.21.15.3:0/2653442425 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc006030 con 0x561ec25b7ad0 2023-03-06T14:16:26.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.862+0000 7f3dcdffb700 1 -- 172.21.15.3:0/2653442425 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0063a0 con 0x561ec25b7ad0 2023-03-06T14:16:26.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.862+0000 7f3dfab98b80 1 -- 172.21.15.3:0/2653442425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25b7ad0 msgr2=0x561ec25b7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:26.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.862+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/2653442425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25b7ad0 0x561ec25b7ea0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc005c50 tx=0x7f3ddc013000 comp rx=0 tx=0).stop 2023-03-06T14:16:26.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.862+0000 7f3dfab98b80 1 -- 172.21.15.3:0/2653442425 shutdown_connections 2023-03-06T14:16:26.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.862+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/2653442425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25b7ad0 0x561ec25b7ea0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.862+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/2653442425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25bb570 0x561ec25d7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.862+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/2653442425 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25bd410 0x561ec25bb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.862+0000 7f3dfab98b80 1 -- 172.21.15.3:0/2653442425 >> 172.21.15.3:0/2653442425 conn(0x561ec25b1720 msgr2=0x561ec25ba5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:26.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.862+0000 7f3dfab98b80 1 -- 172.21.15.3:0/2653442425 shutdown_connections 2023-03-06T14:16:26.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.862+0000 7f3dfab98b80 1 -- 172.21.15.3:0/2653442425 wait complete. 2023-03-06T14:16:26.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.863+0000 7f3dfab98b80 1 -- start start 2023-03-06T14:16:26.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.863+0000 7f3dfab98b80 1 Processor -- start 2023-03-06T14:16:26.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.864+0000 7f3dfab98b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25b7ad0 0x561ec25ef470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.864+0000 7f3dfab98b80 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25bb570 0x561ec25f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.864+0000 7f3dfab98b80 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bd410 0x561ec25ecd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.864+0000 7f3dfab98b80 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ec23928d0 con 0x561ec25bd410 2023-03-06T14:16:26.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.864+0000 7f3dfab98b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ec2604340 con 0x561ec25b7ad0 2023-03-06T14:16:26.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.864+0000 7f3dfab98b80 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ec26035c0 con 0x561ec25bb570 2023-03-06T14:16:26.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.864+0000 7f3dfab98b80 10 client.0 _ll_register_callbacks cb 0x561ec24ac630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-06T14:16:26.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.864+0000 7f3decfac700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bd410 0x561ec25ecd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.864+0000 7f3decfac700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bd410 0x561ec25ecd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56606/0 (socket says 172.21.15.3:56606) 2023-03-06T14:16:26.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.864+0000 7f3decfac700 1 -- 172.21.15.3:0/4202377778 learned_addr learned my addr 172.21.15.3:0/4202377778 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:26.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.864+0000 7f3de7fff700 1 --2- 172.21.15.3:0/4202377778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25b7ad0 0x561ec25ef470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.864+0000 7f3de77fe700 1 --2- 172.21.15.3:0/4202377778 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25bb570 0x561ec25f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.864+0000 7f3decfac700 1 -- 172.21.15.3:0/4202377778 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25bb570 msgr2=0x561ec25f28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:26.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.864+0000 7f3decfac700 1 --2- 172.21.15.3:0/4202377778 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25bb570 0x561ec25f28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.864+0000 7f3decfac700 1 -- 172.21.15.3:0/4202377778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25b7ad0 msgr2=0x561ec25ef470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:26.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.864+0000 7f3decfac700 1 --2- 172.21.15.3:0/4202377778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25b7ad0 0x561ec25ef470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.864+0000 7f3decfac700 1 -- 172.21.15.3:0/4202377778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ddc00e040 con 0x561ec25bd410 2023-03-06T14:16:26.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.865+0000 7f3decfac700 1 --2- 172.21.15.3:0/4202377778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bd410 0x561ec25ecd80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3de0015040 tx=0x7f3de0004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a945d22c28bdff8a server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:26.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.865+0000 7f3dc6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-03-06T14:16:26.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.865+0000 7f3dc6ffd700 1 -- 172.21.15.3:0/4202377778 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0004230 con 0x561ec25bd410 2023-03-06T14:16:26.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.865+0000 7f3dc6ffd700 1 -- 172.21.15.3:0/4202377778 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3de0004390 con 0x561ec25bd410 2023-03-06T14:16:26.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.865+0000 7f3dfab98b80 1 -- 172.21.15.3:0/4202377778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ec24dc140 con 0x561ec25bd410 2023-03-06T14:16:26.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.865+0000 7f3dc6ffd700 1 -- 172.21.15.3:0/4202377778 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3de0004550 con 0x561ec25bd410 2023-03-06T14:16:26.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.865+0000 7f3dfab98b80 10 client.4812 fetch_fsmap learned FSMap version 9 2023-03-06T14:16:26.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.865+0000 7f3dfab98b80 1 -- 172.21.15.3:0/4202377778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x561ec233cd90 con 0x561ec25bd410 2023-03-06T14:16:26.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.865+0000 7f3dc6ffd700 1 -- 172.21.15.3:0/4202377778 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561ec24dc140 con 0x561ec25bd410 2023-03-06T14:16:26.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.865+0000 7f3dc6ffd700 1 -- 172.21.15.3:0/4202377778 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 9) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3de0023030 con 0x561ec25bd410 2023-03-06T14:16:26.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.865+0000 7f3dfab98b80 10 client.4812 fetch_fsmap finished waiting for FSMap version 9 2023-03-06T14:16:26.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.865+0000 7f3dfab98b80 10 client.4812 resolve_mds: resolved name 'c' to daemon mds.c 2023-03-06T14:16:26.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.865+0000 7f3dfab98b80 20 client.4812 populate_metadata read hostname 'smithi003' 2023-03-06T14:16:26.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.865+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/4202377778 >> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] conn(0x561ec26069f0 0x561ec2606dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.865+0000 7f3dfab98b80 4 client.4812 mds_command: new command op to 4287 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-06T14:16:26.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.865+0000 7f3dfab98b80 1 -- 172.21.15.3:0/4202377778 --> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ec2392f10 con 0x561ec26069f0 2023-03-06T14:16:26.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.865+0000 7f3de7fff700 1 --2- 172.21.15.3:0/4202377778 >> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] conn(0x561ec26069f0 0x561ec2606dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.866+0000 7f3dc6ffd700 10 client.4812 ms_handle_connect on v2:172.21.15.3:6833/3655666630 2023-03-06T14:16:26.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.866+0000 7f3de7fff700 1 --2- 172.21.15.3:0/4202377778 >> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] conn(0x561ec26069f0 0x561ec2606dc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e8060d0e2a94d21 server_cookie=f806b3b51fe9a384 in_seq=0 out_seq=0 2023-03-06T14:16:26.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.866+0000 7f3dc6ffd700 1 -- 172.21.15.3:0/4202377778 <== mds.0 v2:172.21.15.3:6833/3655666630 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x561ec2392f10 con 0x561ec26069f0 2023-03-06T14:16:26.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.866+0000 7f3dc6ffd700 10 client.4812 handle_command_reply: tid=0 2023-03-06T14:16:26.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.866+0000 7f3dfab98b80 1 client.4812 shutdown 2023-03-06T14:16:26.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.866+0000 7f3dfab98b80 1 -- 172.21.15.3:0/4202377778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bd410 msgr2=0x561ec25ecd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:26.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.866+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/4202377778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bd410 0x561ec25ecd80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3de0015040 tx=0x7f3de0004b40 comp rx=0 tx=0).stop 2023-03-06T14:16:26.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.867+0000 7f3dfab98b80 1 -- 172.21.15.3:0/4202377778 shutdown_connections 2023-03-06T14:16:26.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.867+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/4202377778 >> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] conn(0x561ec26069f0 0x561ec2606dc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.867+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/4202377778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bd410 0x561ec25ecd80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.867+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/4202377778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25b7ad0 0x561ec25ef470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.867+0000 7f3dc6ffd700 0 client.4812 ms_handle_reset on v2:172.21.15.3:6833/3655666630 2023-03-06T14:16:26.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.867+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/4202377778 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25bb570 0x561ec25f28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.867+0000 7f3dfab98b80 1 -- 172.21.15.3:0/4202377778 >> 172.21.15.3:0/4202377778 conn(0x561ec25b1720 msgr2=0x561ec25b7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:26.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.867+0000 7f3dfab98b80 1 -- 172.21.15.3:0/4202377778 shutdown_connections 2023-03-06T14:16:26.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.867+0000 7f3dfab98b80 1 -- 172.21.15.3:0/4202377778 wait complete. 2023-03-06T14:16:26.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.867+0000 7f3dfab98b80 20 client.4812 trim_cache size 0 max 16384 2023-03-06T14:16:26.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.885+0000 7f3dfab98b80 1 Processor -- start 2023-03-06T14:16:26.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.885+0000 7f3dfab98b80 1 -- start start 2023-03-06T14:16:26.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3dfab98b80 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25b7ad0 0x561ec25ecd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3dfab98b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25bb570 0x561ec25f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3dfab98b80 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bd410 0x561ec25f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3dfab98b80 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ec25f8200 con 0x561ec25bd410 2023-03-06T14:16:26.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3dfab98b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ec25b1120 con 0x561ec25bb570 2023-03-06T14:16:26.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3dfab98b80 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ec25d5360 con 0x561ec25b7ad0 2023-03-06T14:16:26.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3decfac700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bd410 0x561ec25f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3decfac700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bd410 0x561ec25f2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56614/0 (socket says 172.21.15.3:56614) 2023-03-06T14:16:26.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3decfac700 1 -- 172.21.15.3:0/4098508048 learned_addr learned my addr 172.21.15.3:0/4098508048 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:26.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3de7fff700 1 --2- 172.21.15.3:0/4098508048 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25b7ad0 0x561ec25ecd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3de77fe700 1 --2- 172.21.15.3:0/4098508048 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25bb570 0x561ec25f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3decfac700 1 -- 172.21.15.3:0/4098508048 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25b7ad0 msgr2=0x561ec25ecd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:26.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3decfac700 1 --2- 172.21.15.3:0/4098508048 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25b7ad0 0x561ec25ecd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3decfac700 1 -- 172.21.15.3:0/4098508048 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25bb570 msgr2=0x561ec25f26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:26.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3decfac700 1 --2- 172.21.15.3:0/4098508048 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25bb570 0x561ec25f26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3decfac700 1 -- 172.21.15.3:0/4098508048 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ec24d5140 con 0x561ec25bd410 2023-03-06T14:16:26.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3de77fe700 1 --2- 172.21.15.3:0/4098508048 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25bb570 0x561ec25f26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T14:16:26.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3decfac700 1 --2- 172.21.15.3:0/4098508048 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bd410 0x561ec25f2be0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3de000d010 tx=0x7f3de001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8408f66cc285cc server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:26.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3dce7fc700 1 -- 172.21.15.3:0/4098508048 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de000e070 con 0x561ec25bd410 2023-03-06T14:16:26.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3dce7fc700 1 -- 172.21.15.3:0/4098508048 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de000f040 con 0x561ec25bd410 2023-03-06T14:16:26.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.886+0000 7f3dce7fc700 1 -- 172.21.15.3:0/4098508048 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de00041d0 con 0x561ec25bd410 2023-03-06T14:16:26.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.887+0000 7f3dfab98b80 1 -- 172.21.15.3:0/4098508048 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bd410 msgr2=0x561ec25f2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:26.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.887+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/4098508048 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bd410 0x561ec25f2be0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3de000d010 tx=0x7f3de001e000 comp rx=0 tx=0).stop 2023-03-06T14:16:26.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.887+0000 7f3dfab98b80 1 -- 172.21.15.3:0/4098508048 shutdown_connections 2023-03-06T14:16:26.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.887+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/4098508048 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bd410 0x561ec25f2be0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.887+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/4098508048 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25b7ad0 0x561ec25ecd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.887+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/4098508048 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25bb570 0x561ec25f26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.887+0000 7f3dfab98b80 1 -- 172.21.15.3:0/4098508048 >> 172.21.15.3:0/4098508048 conn(0x561ec25b1720 msgr2=0x561ec2615f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:26.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.887+0000 7f3dfab98b80 1 -- 172.21.15.3:0/4098508048 shutdown_connections 2023-03-06T14:16:26.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.887+0000 7f3dfab98b80 1 -- 172.21.15.3:0/4098508048 wait complete. 2023-03-06T14:16:26.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.888+0000 7f3dfab98b80 1 -- start start 2023-03-06T14:16:26.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.888+0000 7f3dfab98b80 1 Processor -- start 2023-03-06T14:16:26.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.888+0000 7f3dfab98b80 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25b7ad0 0x561ec2655320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.888+0000 7f3dfab98b80 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bb570 0x561ec260cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.888+0000 7f3dfab98b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25bd410 0x561ec25ea6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.888+0000 7f3dfab98b80 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ec25bcab0 con 0x561ec25bb570 2023-03-06T14:16:26.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.888+0000 7f3dfab98b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ec25ed580 con 0x561ec25bd410 2023-03-06T14:16:26.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.888+0000 7f3dfab98b80 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ec265f170 con 0x561ec25b7ad0 2023-03-06T14:16:26.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.888+0000 7f3dfab98b80 10 client.0 _ll_register_callbacks cb 0x561ec24ac630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-06T14:16:26.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3de77fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bb570 0x561ec260cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3de77fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bb570 0x561ec260cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56618/0 (socket says 172.21.15.3:56618) 2023-03-06T14:16:26.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3de77fe700 1 -- 172.21.15.3:0/2229714135 learned_addr learned my addr 172.21.15.3:0/2229714135 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:26.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3de7fff700 1 --2- 172.21.15.3:0/2229714135 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25b7ad0 0x561ec2655320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3decfac700 1 --2- 172.21.15.3:0/2229714135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25bd410 0x561ec25ea6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3de77fe700 1 -- 172.21.15.3:0/2229714135 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25b7ad0 msgr2=0x561ec2655320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:26.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3de77fe700 1 --2- 172.21.15.3:0/2229714135 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25b7ad0 0x561ec2655320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3de77fe700 1 -- 172.21.15.3:0/2229714135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25bd410 msgr2=0x561ec25ea6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:26.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3de77fe700 1 --2- 172.21.15.3:0/2229714135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25bd410 0x561ec25ea6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3de77fe700 1 -- 172.21.15.3:0/2229714135 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ec233cd90 con 0x561ec25bb570 2023-03-06T14:16:26.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3decfac700 1 --2- 172.21.15.3:0/2229714135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25bd410 0x561ec25ea6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:26.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3de77fe700 1 --2- 172.21.15.3:0/2229714135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bb570 0x561ec260cdf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8055c30 tx=0x7f3dd8052140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830874d0b43ac7b8 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:26.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3dc6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-03-06T14:16:26.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3dc6ffd700 1 -- 172.21.15.3:0/2229714135 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8051d40 con 0x561ec25bb570 2023-03-06T14:16:26.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3dc6ffd700 1 -- 172.21.15.3:0/2229714135 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3dd8051ea0 con 0x561ec25bb570 2023-03-06T14:16:26.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3dfab98b80 1 -- 172.21.15.3:0/2229714135 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ec24cc160 con 0x561ec25bb570 2023-03-06T14:16:26.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3dc6ffd700 1 -- 172.21.15.3:0/2229714135 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3dd8054cb0 con 0x561ec25bb570 2023-03-06T14:16:26.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3dfab98b80 10 client.4818 fetch_fsmap learned FSMap version 9 2023-03-06T14:16:26.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3dfab98b80 1 -- 172.21.15.3:0/2229714135 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x561ec2363200 con 0x561ec25bb570 2023-03-06T14:16:26.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.889+0000 7f3dc6ffd700 1 -- 172.21.15.3:0/2229714135 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561ec24cc160 con 0x561ec25bb570 2023-03-06T14:16:26.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.890+0000 7f3dc6ffd700 1 -- 172.21.15.3:0/2229714135 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 9) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3dd806f080 con 0x561ec25bb570 2023-03-06T14:16:26.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.890+0000 7f3dfab98b80 10 client.4818 fetch_fsmap finished waiting for FSMap version 9 2023-03-06T14:16:26.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.890+0000 7f3dfab98b80 10 client.4818 resolve_mds: resolved name 'c' to daemon mds.c 2023-03-06T14:16:26.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.890+0000 7f3dfab98b80 20 client.4818 populate_metadata read hostname 'smithi003' 2023-03-06T14:16:26.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.890+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/2229714135 >> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] conn(0x561ec260d330 0x561ec25eac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:26.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.890+0000 7f3dfab98b80 4 client.4818 mds_command: new command op to 4287 tid=0[{"prefix": "status"}] 2023-03-06T14:16:26.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.890+0000 7f3dfab98b80 1 -- 172.21.15.3:0/2229714135 --> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561ec24b6170 con 0x561ec260d330 2023-03-06T14:16:26.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.890+0000 7f3de7fff700 1 --2- 172.21.15.3:0/2229714135 >> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] conn(0x561ec260d330 0x561ec25eac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:26.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.890+0000 7f3dc6ffd700 10 client.4818 ms_handle_connect on v2:172.21.15.3:6833/3655666630 2023-03-06T14:16:26.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.890+0000 7f3de7fff700 1 --2- 172.21.15.3:0/2229714135 >> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] conn(0x561ec260d330 0x561ec25eac00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8ef51c20c0746ad server_cookie=5485ecd076e68311 in_seq=0 out_seq=0 2023-03-06T14:16:26.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.890+0000 7f3dc6ffd700 1 -- 172.21.15.3:0/2229714135 <== mds.0 v2:172.21.15.3:6833/3655666630 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x561ec24b6170 con 0x561ec260d330 2023-03-06T14:16:26.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.890+0000 7f3dc6ffd700 10 client.4818 handle_command_reply: tid=0 2023-03-06T14:16:26.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.890+0000 7f3dfab98b80 1 client.4818 shutdown 2023-03-06T14:16:26.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.890+0000 7f3dfab98b80 1 -- 172.21.15.3:0/2229714135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bb570 msgr2=0x561ec260cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:26.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.890+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/2229714135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bb570 0x561ec260cdf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8055c30 tx=0x7f3dd8052140 comp rx=0 tx=0).stop 2023-03-06T14:16:26.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.890+0000 7f3dfab98b80 1 -- 172.21.15.3:0/2229714135 shutdown_connections 2023-03-06T14:16:26.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.890+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/2229714135 >> [v2:172.21.15.3:6833/3655666630,v1:172.21.15.3:6835/3655666630] conn(0x561ec260d330 0x561ec25eac00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.890+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/2229714135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561ec25bd410 0x561ec25ea6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.891+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/2229714135 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561ec25b7ad0 0x561ec2655320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.891+0000 7f3dc6ffd700 0 client.4818 ms_handle_reset on v2:172.21.15.3:6833/3655666630 2023-03-06T14:16:26.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.891+0000 7f3dfab98b80 1 --2- 172.21.15.3:0/2229714135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561ec25bb570 0x561ec260cdf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.891+0000 7f3dfab98b80 1 -- 172.21.15.3:0/2229714135 >> 172.21.15.3:0/2229714135 conn(0x561ec25b1720 msgr2=0x561ec25f24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:26.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.891+0000 7f3dfab98b80 1 -- 172.21.15.3:0/2229714135 shutdown_connections 2023-03-06T14:16:26.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.891+0000 7f3dfab98b80 1 -- 172.21.15.3:0/2229714135 wait complete. 2023-03-06T14:16:26.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.891+0000 7f3dfab98b80 20 client.4818 trim_cache size 0 max 16384 2023-03-06T14:16:26.903 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-03-06T14:16:26.903 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "9aae2361-5af0-49eb-8f99-e7f69834fedf", 2023-03-06T14:16:26.903 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 0, 2023-03-06T14:16:26.903 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 4287, 2023-03-06T14:16:26.903 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2023-03-06T14:16:26.903 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2023-03-06T14:16:26.904 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2023-03-06T14:16:26.904 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 28.292117362999999, 2023-03-06T14:16:26.904 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 9, 2023-03-06T14:16:26.904 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 27, 2023-03-06T14:16:26.904 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 27, 2023-03-06T14:16:26.904 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 33.743457155999998 2023-03-06T14:16:26.904 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-03-06T14:16:26.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.891+0000 7f3deea0f700 1 -- 172.21.15.3:0/1065606851 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3dd40682f0 msgr2=0x7f3dd406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:26.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.891+0000 7f3deea0f700 1 --2- 172.21.15.3:0/1065606851 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3dd40682f0 0x7f3dd406a7a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3de80a81e0 tx=0x7f3ddc008040 comp rx=0 tx=0).stop 2023-03-06T14:16:26.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.891+0000 7f3deea0f700 1 -- 172.21.15.3:0/1065606851 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de806ee40 msgr2=0x7f3de8148030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:26.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.891+0000 7f3deea0f700 1 --2- 172.21.15.3:0/1065606851 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de806ee40 0x7f3de8148030 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800c500 tx=0x7f3dd800c810 comp rx=0 tx=0).stop 2023-03-06T14:16:26.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.891+0000 7f3deea0f700 1 -- 172.21.15.3:0/1065606851 shutdown_connections 2023-03-06T14:16:26.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.891+0000 7f3deea0f700 1 --2- 172.21.15.3:0/1065606851 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f3dd40682f0 0x7f3dd406a7a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.891+0000 7f3deea0f700 1 --2- 172.21.15.3:0/1065606851 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3de80bdd60 0x7f3de8148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.891+0000 7f3deea0f700 1 --2- 172.21.15.3:0/1065606851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3de806ea70 0x7f3de8152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.891+0000 7f3deea0f700 1 --2- 172.21.15.3:0/1065606851 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de806ee40 0x7f3de8148030 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:26.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.891+0000 7f3deea0f700 1 -- 172.21.15.3:0/1065606851 >> 172.21.15.3:0/1065606851 conn(0x7f3de80c2150 msgr2=0x7f3de814b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:26.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.891+0000 7f3deea0f700 1 -- 172.21.15.3:0/1065606851 shutdown_connections 2023-03-06T14:16:26.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:26.891+0000 7f3deea0f700 1 -- 172.21.15.3:0/1065606851 wait complete. 2023-03-06T14:16:26.907 INFO:teuthology.run_tasks:Running task kclient... 2023-03-06T14:16:26.928 INFO:tasks.kclient:Mounting kernel clients... 2023-03-06T14:16:26.929 INFO:tasks.kclient:config is {'client.0': {}} 2023-03-06T14:16:26.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:26.929 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2023-03-06T14:16:26.946 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-03-06T14:16:26.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:26.947 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-03-06T14:16:27.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:27.028 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link delete ceph-brx 2023-03-06T14:16:27.136 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-03-06T14:16:27.137 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-06T14:16:27.138 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-06T14:16:27.138 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-06T14:16:27.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.264+0000 7f17a3edf700 1 Processor -- start 2023-03-06T14:16:27.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.264+0000 7f17a3edf700 1 -- start start 2023-03-06T14:16:27.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.265+0000 7f17a3edf700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f179c148a00 0x7f179c0b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:27.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.265+0000 7f17a3edf700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f179c0bc3c0 0x7f179c0bcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:27.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.265+0000 7f17a3edf700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f179c0b6890 con 0x7f179c0704b0 2023-03-06T14:16:27.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.265+0000 7f17a3edf700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f179c14b4a0 con 0x7f179c148a00 2023-03-06T14:16:27.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.265+0000 7f17a3edf700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179c0b6d30 con 0x7f179c0bc3c0 2023-03-06T14:16:27.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.265+0000 7f17a1c7b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f179c148a00 0x7f179c0b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:27.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.265+0000 7f17a1c7b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f179c148a00 0x7f179c0b7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56624/0 (socket says 172.21.15.3:56624) 2023-03-06T14:16:27.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.265+0000 7f17a1c7b700 1 -- 172.21.15.3:0/905132092 learned_addr learned my addr 172.21.15.3:0/905132092 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:27.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.265+0000 7f17a147a700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f179c0704b0 0x7f179c14be70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58896/0 (socket says 172.21.15.3:58896) 2023-03-06T14:16:27.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.265+0000 7f17a247c700 1 --2- 172.21.15.3:0/905132092 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f179c0bc3c0 0x7f179c0bcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:27.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.265+0000 7f17a1c7b700 1 -- 172.21.15.3:0/905132092 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f179c0bc3c0 msgr2=0x7f179c0bcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T14:16:27.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.265+0000 7f17a1c7b700 1 --2- 172.21.15.3:0/905132092 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f179c0bc3c0 0x7f179c0bcf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:27.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.266+0000 7f17a1c7b700 1 -- 172.21.15.3:0/905132092 >> v1:172.21.15.3:6789/0 conn(0x7f179c0704b0 legacy=0x7f179c14be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:27.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.266+0000 7f17a1c7b700 1 -- 172.21.15.3:0/905132092 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c14b6b0 con 0x7f179c148a00 2023-03-06T14:16:27.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.266+0000 7f17a0c79700 1 -- 172.21.15.3:0/905132092 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319668110 0 0) 0x7f179c0b6890 con 0x7f179c0704b0 2023-03-06T14:16:27.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.266+0000 7f17a247c700 1 --2- 172.21.15.3:0/905132092 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f179c0bc3c0 0x7f179c0bcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T14:16:27.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.266+0000 7f17a1c7b700 1 --2- 172.21.15.3:0/905132092 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f179c148a00 0x7f179c0b7c20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f178c00bb90 tx=0x7f178c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca45e8ee3e7e7f6 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:27.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.266+0000 7f17a0c79700 1 -- 172.21.15.3:0/905132092 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c00dd50 con 0x7f179c148a00 2023-03-06T14:16:27.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.266+0000 7f17a0c79700 1 -- 172.21.15.3:0/905132092 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178c010470 con 0x7f179c148a00 2023-03-06T14:16:27.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.266+0000 7f17a0c79700 1 -- 172.21.15.3:0/905132092 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c010800 con 0x7f179c148a00 2023-03-06T14:16:27.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.266+0000 7f17a3edf700 1 -- 172.21.15.3:0/905132092 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f179c148a00 msgr2=0x7f179c0b7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:27.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.266+0000 7f17a3edf700 1 --2- 172.21.15.3:0/905132092 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f179c148a00 0x7f179c0b7c20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f178c00bb90 tx=0x7f178c00bea0 comp rx=0 tx=0).stop 2023-03-06T14:16:27.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.266+0000 7f17a3edf700 1 -- 172.21.15.3:0/905132092 shutdown_connections 2023-03-06T14:16:27.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.266+0000 7f17a3edf700 1 --2- 172.21.15.3:0/905132092 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f179c0bc3c0 0x7f179c0bcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:27.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.266+0000 7f17a3edf700 1 --2- 172.21.15.3:0/905132092 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f179c148a00 0x7f179c0b7c20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:27.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.266+0000 7f17a3edf700 1 -- 172.21.15.3:0/905132092 >> 172.21.15.3:0/905132092 conn(0x7f179c0c0eb0 msgr2=0x7f179c0c12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:27.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.267+0000 7f17a3edf700 1 -- 172.21.15.3:0/905132092 shutdown_connections 2023-03-06T14:16:27.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.267+0000 7f17a3edf700 1 -- 172.21.15.3:0/905132092 wait complete. 2023-03-06T14:16:27.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.268+0000 7f17a3edf700 1 Processor -- start 2023-03-06T14:16:27.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.268+0000 7f17a3edf700 1 -- start start 2023-03-06T14:16:27.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.268+0000 7f17a3edf700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f179c0bc3c0 0x7f179c06aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:27.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.268+0000 7f17a3edf700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f179c148a00 0x7f179c1e03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:27.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.268+0000 7f17a3edf700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f179c06af60 0x7f179c1e0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:27.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.268+0000 7f17a3edf700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c140e00 con 0x7f179c06af60 2023-03-06T14:16:27.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.268+0000 7f17a3edf700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c141890 con 0x7f179c148a00 2023-03-06T14:16:27.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.268+0000 7f17a3edf700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179c141060 con 0x7f179c0bc3c0 2023-03-06T14:16:27.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.268+0000 7f17a247c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f179c06af60 0x7f179c1e0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:27.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.269+0000 7f17a247c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f179c06af60 0x7f179c1e0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56632/0 (socket says 172.21.15.3:56632) 2023-03-06T14:16:27.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.269+0000 7f17a247c700 1 -- 172.21.15.3:0/2682462930 learned_addr learned my addr 172.21.15.3:0/2682462930 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-03-06T14:16:27.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.269+0000 7f17a1c7b700 1 --2- 172.21.15.3:0/2682462930 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f179c0bc3c0 0x7f179c06aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:27.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.269+0000 7f17a147a700 1 --2- 172.21.15.3:0/2682462930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f179c148a00 0x7f179c1e03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:27.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.269+0000 7f17a247c700 1 -- 172.21.15.3:0/2682462930 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f179c0bc3c0 msgr2=0x7f179c06aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:27.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.269+0000 7f17a247c700 1 --2- 172.21.15.3:0/2682462930 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f179c0bc3c0 0x7f179c06aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:27.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.269+0000 7f17a247c700 1 -- 172.21.15.3:0/2682462930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f179c148a00 msgr2=0x7f179c1e03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:27.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.269+0000 7f17a247c700 1 --2- 172.21.15.3:0/2682462930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f179c148a00 0x7f179c1e03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:27.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.269+0000 7f17a247c700 1 -- 172.21.15.3:0/2682462930 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c00b7f0 con 0x7f179c06af60 2023-03-06T14:16:27.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.269+0000 7f17a247c700 1 --2- 172.21.15.3:0/2682462930 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f179c06af60 0x7f179c1e0900 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1794007f20 tx=0x7f179400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:27.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.269+0000 7f17927fc700 1 -- 172.21.15.3:0/2682462930 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179400de30 con 0x7f179c06af60 2023-03-06T14:16:27.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.269+0000 7f17927fc700 1 -- 172.21.15.3:0/2682462930 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179400f040 con 0x7f179c06af60 2023-03-06T14:16:27.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.269+0000 7f17a3edf700 1 -- 172.21.15.3:0/2682462930 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179c0b6fd0 con 0x7f179c06af60 2023-03-06T14:16:27.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.269+0000 7f17927fc700 1 -- 172.21.15.3:0/2682462930 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794003c60 con 0x7f179c06af60 2023-03-06T14:16:27.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.269+0000 7f17a3edf700 1 -- 172.21.15.3:0/2682462930 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179c0b72b0 con 0x7f179c06af60 2023-03-06T14:16:27.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.270+0000 7f17a3edf700 1 -- 172.21.15.3:0/2682462930 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179c14b950 con 0x7f179c06af60 2023-03-06T14:16:27.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.271+0000 7f17927fc700 1 -- 172.21.15.3:0/2682462930 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f179401c030 con 0x7f179c06af60 2023-03-06T14:16:27.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.271+0000 7f17927fc700 1 --2- 172.21.15.3:0/2682462930 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f17800682f0 0x7f178006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T14:16:27.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.271+0000 7f17927fc700 1 -- 172.21.15.3:0/2682462930 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1794085fc0 con 0x7f179c06af60 2023-03-06T14:16:27.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.271+0000 7f17a1c7b700 1 --2- 172.21.15.3:0/2682462930 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f17800682f0 0x7f178006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T14:16:27.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.272+0000 7f17a1c7b700 1 --2- 172.21.15.3:0/2682462930 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f17800682f0 0x7f178006a7a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f178c00bee0 tx=0x7f178c013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T14:16:27.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.275+0000 7f17927fc700 1 -- 172.21.15.3:0/2682462930 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1794052530 con 0x7f179c06af60 2023-03-06T14:16:27.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.518+0000 7f17a3edf700 1 -- 172.21.15.3:0/2682462930 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f179c066ca0 con 0x7f179c06af60 2023-03-06T14:16:27.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.518+0000 7f17927fc700 1 -- 172.21.15.3:0/2682462930 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f179401a020 con 0x7f179c06af60 2023-03-06T14:16:27.521 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-03-06T14:16:27.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.520+0000 7f17a3edf700 1 -- 172.21.15.3:0/2682462930 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f17800682f0 msgr2=0x7f178006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:27.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.520+0000 7f17a3edf700 1 --2- 172.21.15.3:0/2682462930 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f17800682f0 0x7f178006a7a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f178c00bee0 tx=0x7f178c013000 comp rx=0 tx=0).stop 2023-03-06T14:16:27.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.520+0000 7f17a3edf700 1 -- 172.21.15.3:0/2682462930 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f179c06af60 msgr2=0x7f179c1e0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T14:16:27.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.520+0000 7f17a3edf700 1 --2- 172.21.15.3:0/2682462930 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f179c06af60 0x7f179c1e0900 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1794007f20 tx=0x7f179400d3b0 comp rx=0 tx=0).stop 2023-03-06T14:16:27.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.520+0000 7f17a3edf700 1 -- 172.21.15.3:0/2682462930 shutdown_connections 2023-03-06T14:16:27.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.520+0000 7f17a3edf700 1 --2- 172.21.15.3:0/2682462930 >> [v2:172.21.15.136:6832/96144,v1:172.21.15.136:6833/96144] conn(0x7f17800682f0 0x7f178006a7a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:27.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.520+0000 7f17a3edf700 1 --2- 172.21.15.3:0/2682462930 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f179c06af60 0x7f179c1e0900 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:27.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.520+0000 7f17a3edf700 1 --2- 172.21.15.3:0/2682462930 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f179c0bc3c0 0x7f179c06aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:27.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.520+0000 7f17a3edf700 1 --2- 172.21.15.3:0/2682462930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f179c148a00 0x7f179c1e03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T14:16:27.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.520+0000 7f17a3edf700 1 -- 172.21.15.3:0/2682462930 >> 172.21.15.3:0/2682462930 conn(0x7f179c0c0eb0 msgr2=0x7f179c0b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T14:16:27.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.520+0000 7f17a3edf700 1 -- 172.21.15.3:0/2682462930 shutdown_connections 2023-03-06T14:16:27.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-03-06T14:16:27.520+0000 7f17a3edf700 1 -- 172.21.15.3:0/2682462930 wait complete. 2023-03-06T14:16:27.534 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-03-06T14:16:27.534 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-06T14:16:27.534 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi003.front.sepia.ceph.com 2023-03-06T14:16:27.534 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-03-06T14:16:27.535 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-06T14:16:27.535 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-03-06T14:16:27.535 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-06T14:16:27.535 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-06T14:16:27.535 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-06T14:16:27.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:27.536 DEBUG:teuthology.orchestra.run.smithi003:> ip addr 2023-03-06T14:16:27.553 INFO:teuthology.orchestra.run.smithi003.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-06T14:16:27.553 INFO:teuthology.orchestra.run.smithi003.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-06T14:16:27.554 INFO:teuthology.orchestra.run.smithi003.stdout: inet 127.0.0.1/8 scope host lo 2023-03-06T14:16:27.554 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-03-06T14:16:27.554 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 ::1/128 scope host 2023-03-06T14:16:27.554 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-03-06T14:16:27.554 INFO:teuthology.orchestra.run.smithi003.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-06T14:16:27.554 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ac brd ff:ff:ff:ff:ff:ff 2023-03-06T14:16:27.554 INFO:teuthology.orchestra.run.smithi003.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-06T14:16:27.555 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ad brd ff:ff:ff:ff:ff:ff 2023-03-06T14:16:27.555 INFO:teuthology.orchestra.run.smithi003.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-06T14:16:27.555 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dc brd ff:ff:ff:ff:ff:ff 2023-03-06T14:16:27.555 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.21.15.3/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-03-06T14:16:27.555 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft 42476sec preferred_lft 42476sec 2023-03-06T14:16:27.555 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::ec4:7aff:febd:15dc/64 scope link 2023-03-06T14:16:27.555 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2023-03-06T14:16:27.556 INFO:teuthology.orchestra.run.smithi003.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-06T14:16:27.556 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dd brd ff:ff:ff:ff:ff:ff 2023-03-06T14:16:27.556 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-03-06T14:16:27.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:27.557 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-03-06T14:16:27.557 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-03-06T14:16:27.558 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link add name ceph-brx type bridge 2023-03-06T14:16:27.558 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip addr flush dev ceph-brx 2023-03-06T14:16:27.559 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set ceph-brx up 2023-03-06T14:16:27.559 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-03-06T14:16:27.559 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-03-06T14:16:27.632 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:16:27.638 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:16:27.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:27.674 DEBUG:teuthology.orchestra.run.smithi003:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-06T14:16:27.767 INFO:teuthology.orchestra.run.smithi003.stdout:1 2023-03-06T14:16:27.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:27.769 DEBUG:teuthology.orchestra.run.smithi003:> route 2023-03-06T14:16:27.828 INFO:teuthology.orchestra.run.smithi003.stdout:Kernel IP routing table 2023-03-06T14:16:27.829 INFO:teuthology.orchestra.run.smithi003.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-06T14:16:27.829 INFO:teuthology.orchestra.run.smithi003.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-03-06T14:16:27.829 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-03-06T14:16:27.829 INFO:teuthology.orchestra.run.smithi003.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-06T14:16:27.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:27.830 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-03-06T14:16:27.830 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-03-06T14:16:27.830 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-03-06T14:16:27.830 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-03-06T14:16:27.831 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-03-06T14:16:27.831 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-03-06T14:16:27.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:27.936 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2023-03-06T14:16:27.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:27.954 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list-id 2023-03-06T14:16:28.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:28.010 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-03-06T14:16:28.011 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-03-06T14:16:28.011 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-03-06T14:16:28.011 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-03-06T14:16:28.011 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-03-06T14:16:28.106 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-03-06T14:16:28.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:28.107 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-03-06T14:16:28.107 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-03-06T14:16:28.107 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-03-06T14:16:28.108 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-03-06T14:16:28.108 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-03-06T14:16:28.109 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-03-06T14:16:28.109 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-03-06T14:16:28.110 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-03-06T14:16:28.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:28.317 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec bash -c ' 2023-03-06T14:16:28.317 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2023-03-06T14:16:28.317 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set brx.0 up 2023-03-06T14:16:28.318 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set dev brx.0 master ceph-brx 2023-03-06T14:16:28.318 DEBUG:teuthology.orchestra.run.smithi003:> ') 2023-03-06T14:16:28.434 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-06T14:16:28.435 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-03-06T14:16:28.467 INFO:teuthology.orchestra.run.smithi003.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-03-06T14:16:28.468 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-06T14:16:28.468 DEBUG:teuthology.orchestra.run.smithi003:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-03-06T14:16:28.524 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-03-06T14:16:28.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:28.525 DEBUG:teuthology.orchestra.run.smithi003:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-06T14:16:28.611 INFO:teuthology.orchestra.run.smithi003.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-06T14:16:28.611 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-06T14:16:28.767 INFO:teuthology.orchestra.run.smithi003.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-06T14:16:28.767 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-06T14:16:28.767 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: resolved to: "172.21.15.3:3300,172.21.15.136:3300,172.21.15.136:3301" 2023-03-06T14:16:28.767 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: trying mount with new device syntax: 0@9aae2361-5af0-49eb-8f99-e7f69834fedf.cephfs=/ 2023-03-06T14:16:28.767 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.3:3300/172.21.15.136:3300/172.21.15.136:3301" will pass to kernel 2023-03-06T14:16:28.768 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: v2 mount support check returned 2 2023-03-06T14:16:28.768 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-06T14:16:28.768 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-06T14:16:28.840 INFO:teuthology.orchestra.run.smithi003.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-06T14:16:28.840 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-06T14:16:28.841 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: resolved to: "172.21.15.3:3300,172.21.15.136:3300,172.21.15.136:3301" 2023-03-06T14:16:28.841 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: trying mount with new device syntax: 0@9aae2361-5af0-49eb-8f99-e7f69834fedf.cephfs=/ 2023-03-06T14:16:28.841 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.3:3300/172.21.15.136:3300/172.21.15.136:3301" will pass to kernel 2023-03-06T14:16:28.841 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: v2 mount support check returned 2 2023-03-06T14:16:28.841 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-06T14:16:28.841 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-06T14:16:28.841 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: resolved to: "172.21.15.3:6789,172.21.15.136:6789,172.21.15.136:6790" 2023-03-06T14:16:28.842 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.3:6789,172.21.15.136:6789,172.21.15.136:6790:/ 2023-03-06T14:16:28.842 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=9aae2361-5af0-49eb-8f99-e7f69834fedf" will pass to kernel 2023-03-06T14:16:28.843 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-06T14:16:28.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:28.843 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-03-06T14:16:28.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:28.870 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-06T14:16:28.942 INFO:teuthology.orchestra.run.smithi003.stdout:client4696 2023-03-06T14:16:28.943 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:16:28.943 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-06T14:16:29.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:29.001 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-06T14:16:29.073 INFO:teuthology.orchestra.run.smithi003.stdout:client4696 2023-03-06T14:16:29.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:29.075 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-06T14:16:29.147 INFO:teuthology.orchestra.run.smithi003.stdout:client4696 2023-03-06T14:16:29.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T14:16:29.147 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9aae2361-5af0-49eb-8f99-e7f69834fedf.client4696/status') 2023-03-06T14:16:29.229 INFO:teuthology.orchestra.run.smithi003.stdout:instance: client.4696 (3)172.21.15.3:0/4118917390 2023-03-06T14:16:29.229 INFO:teuthology.orchestra.run.smithi003.stdout:blocklisted: false 2023-03-06T14:16:29.230 INFO:teuthology.orchestra.run.smithi003.stderr:0+1 records in 2023-03-06T14:16:29.230 INFO:teuthology.orchestra.run.smithi003.stderr:0+1 records out 2023-03-06T14:16:29.230 INFO:teuthology.orchestra.run.smithi003.stderr:69 bytes copied, 2.4233e-05 s, 2.8 MB/s 2023-03-06T14:16:29.231 INFO:teuthology.run_tasks:Running task workunit... 2023-03-06T14:16:29.243 INFO:tasks.workunit:Pulling workunits from ref 472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-06T14:16:29.244 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-03-06T14:16:29.244 INFO:tasks.workunit:timeout=6h 2023-03-06T14:16:29.244 INFO:tasks.workunit:cleanup=True 2023-03-06T14:16:29.244 DEBUG:teuthology.orchestra.run.smithi003:> stat -- /home/ubuntu/cephtest/mnt.0 2023-03-06T14:16:29.287 INFO:teuthology.orchestra.run.smithi003.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-03-06T14:16:29.287 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-03-06T14:16:29.287 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 2fh/47d Inode: 1 Links: 2 2023-03-06T14:16:29.287 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-06T14:16:29.288 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:cephfs_t:s0 2023-03-06T14:16:29.288 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-03-06T14:16:29.288 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-03-06 14:15:58.599843128 +0000 2023-03-06T14:16:29.288 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-03-06 14:16:09.033823344 +0000 2023-03-06T14:16:29.288 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2023-03-06 14:15:58.599843128 +0000 2023-03-06T14:16:29.288 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-03-06T14:16:29.289 DEBUG:teuthology.orchestra.run.smithi003:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-03-06T14:16:29.358 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-06T14:16:29.415 INFO:tasks.workunit.client.0.smithi003.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-03-06T14:16:57.701 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:16:57.704 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:17:18.490 INFO:tasks.workunit.client.0.smithi003.stderr:Updating files: 98% (11409/11620) Updating files: 99% (11504/11620) Updating files: 100% (11620/11620) Updating files: 100% (11620/11620), done. 2023-03-06T14:17:18.991 INFO:tasks.workunit.client.0.smithi003.stderr:Note: switching to '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'. 2023-03-06T14:17:18.991 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-03-06T14:17:18.992 INFO:tasks.workunit.client.0.smithi003.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-03-06T14:17:18.992 INFO:tasks.workunit.client.0.smithi003.stderr:changes and commit them, and you can discard any commits you make in this 2023-03-06T14:17:18.992 INFO:tasks.workunit.client.0.smithi003.stderr:state without impacting any branches by switching back to a branch. 2023-03-06T14:17:18.992 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-03-06T14:17:18.992 INFO:tasks.workunit.client.0.smithi003.stderr:If you want to create a new branch to retain commits you create, you may 2023-03-06T14:17:18.992 INFO:tasks.workunit.client.0.smithi003.stderr:do so (now or later) by using -c with the switch command. Example: 2023-03-06T14:17:18.992 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-03-06T14:17:18.993 INFO:tasks.workunit.client.0.smithi003.stderr: git switch -c 2023-03-06T14:17:18.993 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-03-06T14:17:18.993 INFO:tasks.workunit.client.0.smithi003.stderr:Or undo this operation with: 2023-03-06T14:17:18.993 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-03-06T14:17:18.993 INFO:tasks.workunit.client.0.smithi003.stderr: git switch - 2023-03-06T14:17:18.993 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-03-06T14:17:18.993 INFO:tasks.workunit.client.0.smithi003.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-03-06T14:17:18.993 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-03-06T14:17:18.994 INFO:tasks.workunit.client.0.smithi003.stderr:HEAD is now at 472aaef4ec3 Merge PR #45224 into wip-vshankar-testing-20230303.023823 2023-03-06T14:17:18.995 DEBUG:teuthology.orchestra.run.smithi003:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-03-06T14:17:19.025 INFO:tasks.workunit.client.0.smithi003.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-03-06T14:17:19.027 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-03-06T14:17:19.027 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-03-06T14:17:19.585 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-03-06T14:17:19.640 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-03-06T14:17:19.679 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-03-06T14:17:19.681 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-03-06T14:17:19.681 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-03-06T14:17:19.719 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-03-06T14:17:19.722 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-03-06T14:17:19.722 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-03-06T14:17:19.779 INFO:tasks.workunit:Running workunits matching fs/snaps on client.0... 2023-03-06T14:17:19.780 INFO:tasks.workunit:Running workunit fs/snaps/snap-rm-diff.sh... 2023-03-06T14:17:19.780 DEBUG:teuthology.orchestra.run.smithi003:workunit test fs/snaps/snap-rm-diff.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=472aaef4ec3b3a2c29f73ca67854785a910f1f9b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snap-rm-diff.sh 2023-03-06T14:17:19.841 INFO:tasks.workunit.client.0.smithi003.stderr:+ wget -q http://download.ceph.com/qa/linux-2.6.33.tar.bz2 2023-03-06T14:17:22.716 INFO:tasks.workunit.client.0.smithi003.stderr:+ mkdir foo 2023-03-06T14:17:22.721 INFO:tasks.workunit.client.0.smithi003.stderr:+ cp linux-2.6.33.tar.bz2 foo 2023-03-06T14:17:22.765 INFO:tasks.workunit.client.0.smithi003.stderr:+ mkdir foo/.snap/barsnap 2023-03-06T14:17:22.791 INFO:tasks.workunit.client.0.smithi003.stderr:+ rm foo/linux-2.6.33.tar.bz2 2023-03-06T14:17:22.805 INFO:tasks.workunit.client.0.smithi003.stderr:+ diff -q foo/.snap/barsnap/linux-2.6.33.tar.bz2 linux-2.6.33.tar.bz2 2023-03-06T14:17:22.990 INFO:tasks.workunit.client.0.smithi003.stdout:passed: files are identical 2023-03-06T14:17:22.991 INFO:tasks.workunit.client.0.smithi003.stderr:+ echo 'passed: files are identical' 2023-03-06T14:17:22.991 INFO:tasks.workunit.client.0.smithi003.stderr:+ rmdir foo/.snap/barsnap 2023-03-06T14:17:22.998 INFO:tasks.workunit.client.0.smithi003.stdout:OK 2023-03-06T14:17:22.999 INFO:tasks.workunit.client.0.smithi003.stderr:+ echo OK 2023-03-06T14:17:23.000 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-03-06T14:17:23.000 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-03-06T14:17:23.068 INFO:tasks.ceph.mds.c.smithi003.stderr:2023-03-06T14:17:23.066+0000 7fe57e302700 -1 mds.0.cache.den(0x601 10000000002) newly corrupt dentry to be committed: [dentry #0x100/stray1/10000000002 [4,head] auth NULL (dn xlock x=1 by 0x562b76be5c00) (dversion lock w=1 last_client=4696) pv=21 v=20 ap=2 ino=(nil) state=1342177281|new | request=1 lock=2 authpin=1 0x562b76c7f180] 2023-03-06T14:17:23.068 INFO:tasks.ceph.mds.c.smithi003.stderr:2023-03-06T14:17:23.066+0000 7fe57e302700 -1 mds.0.damage notify_dentry Damage to dentries in fragment * of ino 0x601is fatal because it is a system directory for this rank 2023-03-06T14:17:23.291 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T14:17:23.290+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-03-06T14:17:23.292 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T14:17:23.290+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-03-06T14:17:23.309 INFO:tasks.ceph.mds.c.smithi003.stderr: -27> 2023-03-06T14:17:23.066+0000 7fe57e302700 -1 mds.0.cache.den(0x601 10000000002) newly corrupt dentry to be committed: [dentry #0x100/stray1/10000000002 [4,head] auth NULL (dn xlock x=1 by 0x562b76be5c00) (dversion lock w=1 last_client=4696) pv=21 v=20 ap=2 ino=(nil) state=1342177281|new | request=1 lock=2 authpin=1 0x562b76c7f180] 2023-03-06T14:17:23.309 INFO:tasks.ceph.mds.c.smithi003.stderr: -25> 2023-03-06T14:17:23.066+0000 7fe57e302700 -1 mds.0.damage notify_dentry Damage to dentries in fragment * of ino 0x601is fatal because it is a system directory for this rank 2023-03-06T14:17:23.333 INFO:tasks.ceph.mds.c.smithi003.stdout:starting mds.c at 2023-03-06T14:17:27.768 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:17:27.771 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:17:57.892 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:17:57.895 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:18:27.970 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:18:27.973 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:18:58.051 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:18:58.054 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:19:28.131 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:19:28.134 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:19:58.220 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:19:58.223 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:20:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T14:19:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T14:20:28.301 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:20:28.304 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:20:58.422 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:20:58.425 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:21:28.487 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:21:28.490 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:21:58.577 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:21:58.580 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:22:28.731 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:22:28.734 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:22:58.805 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:22:58.808 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:23:28.870 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:23:28.874 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:23:58.941 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:23:58.944 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:24:29.093 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:24:29.096 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:24:59.189 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:24:59.192 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:25:29.300 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:25:29.304 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:25:59.646 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:25:59.649 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:26:29.732 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:26:29.735 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:26:59.809 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:26:59.812 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:27:29.930 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:27:29.933 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:27:59.990 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:27:59.993 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:28:30.153 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:28:30.156 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:29:00.257 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:29:00.260 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:29:30.327 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:29:30.330 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:30:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T14:29:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T14:30:00.396 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:30:00.398 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:30:30.549 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:30:30.552 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:31:00.628 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:31:00.631 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:31:30.706 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:31:30.709 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:32:00.834 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:32:00.837 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:32:30.904 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:32:30.907 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:33:01.001 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:33:01.004 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:33:31.152 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:33:31.155 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:34:01.439 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:34:01.442 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:34:31.561 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:34:31.564 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:35:01.654 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:35:01.658 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:35:31.741 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:35:31.744 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:36:01.826 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:36:01.829 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:36:31.896 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:36:31.900 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:37:02.033 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:37:02.036 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:37:32.104 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:37:32.106 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:38:02.173 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:38:02.176 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:38:32.285 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:38:32.287 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:39:02.354 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:39:02.357 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:39:32.416 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:39:32.419 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:40:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T14:39:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T14:40:02.552 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:40:02.555 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:40:32.648 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:40:32.651 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:41:02.719 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:41:02.722 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:41:32.821 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:41:32.824 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:42:02.890 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:42:02.892 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:42:32.953 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:42:32.956 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:43:03.081 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:43:03.084 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:43:33.284 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:43:33.287 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:44:03.354 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:44:03.357 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:44:33.416 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:44:33.419 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:45:03.479 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:45:03.482 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:45:33.555 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:45:33.558 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:46:03.642 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:46:03.645 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:46:33.795 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:46:33.798 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:47:03.866 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:47:03.869 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:47:33.927 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:47:33.930 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:48:04.047 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:48:04.051 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:48:34.131 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:48:34.134 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:49:04.221 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:49:04.224 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:49:34.368 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:49:34.371 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:50:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T14:50:00.000+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T14:50:04.430 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:50:04.433 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:50:34.533 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:50:34.536 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:51:04.661 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:51:04.664 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:51:34.722 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:51:34.724 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:52:04.801 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:52:04.805 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:52:34.945 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:52:34.949 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:53:05.016 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:53:05.019 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:53:35.083 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:53:35.086 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:54:05.180 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:54:05.183 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:54:35.243 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:54:35.246 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:55:05.312 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:55:05.315 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:55:35.465 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:55:35.468 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:56:05.567 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:56:05.570 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:56:35.631 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:56:35.633 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:57:05.693 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:57:05.701 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:57:35.770 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:57:35.773 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:58:05.830 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:58:05.833 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:58:35.984 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:58:35.987 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:59:06.254 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:59:06.258 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:59:36.356 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:59:36.360 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:00:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T14:59:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T15:00:06.425 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:00:06.428 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:00:36.564 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:00:36.567 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:01:06.668 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:01:06.671 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:01:36.740 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:01:36.743 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:02:06.899 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:02:06.903 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:02:36.975 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:02:36.978 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:03:07.030 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:03:07.033 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:03:37.108 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:03:37.111 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:04:07.187 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:04:07.190 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:04:37.254 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:04:37.257 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:05:07.335 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:05:07.338 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:05:37.423 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:05:37.426 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:06:07.490 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:06:07.493 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:06:37.627 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:06:37.629 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:07:07.697 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:07:07.699 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:07:37.768 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:07:37.771 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:08:07.895 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:08:07.898 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:08:37.968 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:08:37.972 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:09:08.043 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:09:08.046 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:09:38.146 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:09:38.149 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:10:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T15:09:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T15:10:08.218 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:10:08.221 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:10:38.324 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:10:38.327 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:11:08.447 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:11:08.450 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:11:38.518 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:11:38.521 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:12:08.581 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:12:08.583 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:12:38.682 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:12:38.686 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:13:08.750 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:13:08.753 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:13:38.814 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:13:38.817 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:14:08.951 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:14:08.953 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:14:39.037 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:14:39.040 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:15:09.137 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:15:09.140 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:15:39.219 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:15:39.222 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:16:09.289 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:16:09.292 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:16:39.360 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:16:39.363 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:17:09.495 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:17:09.498 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:17:23.048 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-03-06T15:17:23.053 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-03-06T15:17:39.807 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:17:39.810 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:18:09.901 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:18:09.904 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:18:39.988 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:18:39.992 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:19:10.074 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:19:10.077 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:19:40.137 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:19:40.141 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:20:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T15:19:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T15:20:10.205 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:20:10.208 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:20:40.368 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:20:40.371 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:21:10.449 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:21:10.453 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:21:40.541 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:21:40.543 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:22:10.660 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:22:10.663 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:22:40.754 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:22:40.757 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:23:10.842 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:23:10.847 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:23:40.987 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:23:40.990 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:24:11.131 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:24:11.134 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:24:41.208 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:24:41.211 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:25:11.389 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:25:11.392 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:25:41.460 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:25:41.464 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:26:11.561 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:26:11.564 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:26:41.739 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:26:41.742 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:27:11.842 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:27:11.845 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:27:41.922 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:27:41.925 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:28:11.999 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:28:12.002 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:28:42.144 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:28:42.147 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:29:12.215 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:29:12.218 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:29:42.284 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:29:42.286 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:29:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T15:29:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T15:30:12.447 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:30:12.450 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:30:42.533 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:30:42.537 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:31:12.603 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:31:12.605 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:31:42.723 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:31:42.725 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:32:13.051 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:32:13.054 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:32:43.163 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:32:43.165 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:33:13.250 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:33:13.253 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:33:43.402 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:33:43.404 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:34:13.472 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:34:13.475 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:34:43.561 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:34:43.564 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:35:13.629 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:35:13.632 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:35:43.715 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:35:43.718 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:36:13.812 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:36:13.815 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:36:43.947 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:36:43.950 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:37:14.309 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:37:14.312 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:37:44.387 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:37:44.390 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:38:14.540 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:38:14.544 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:38:44.619 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:38:44.622 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:39:14.690 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:39:14.693 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:39:44.860 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:39:44.863 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:40:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T15:39:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T15:40:14.986 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:40:14.989 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:40:45.055 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:40:45.058 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:41:15.127 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:41:15.130 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:41:45.262 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:41:45.265 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:42:15.337 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:42:15.340 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:42:45.403 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:42:45.405 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:43:15.556 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:43:15.559 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:43:45.636 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:43:45.639 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:44:15.703 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:44:15.706 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:44:45.857 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:44:45.860 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:45:15.927 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:45:15.931 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:45:45.997 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:45:46.025 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:46:16.150 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:46:16.153 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:46:46.215 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:46:46.218 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:47:16.282 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:47:16.285 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:47:46.402 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:47:46.404 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:48:16.580 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:48:16.583 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:48:46.656 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:48:46.658 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:49:16.742 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:49:16.745 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:49:46.912 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:49:46.915 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:50:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T15:49:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T15:50:16.975 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:50:16.978 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:50:47.047 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:50:47.050 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:51:17.189 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:51:17.197 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:51:47.267 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:51:47.270 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:52:17.345 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:52:17.348 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:52:47.491 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:52:47.495 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:53:17.547 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:53:17.550 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:53:47.630 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:53:47.633 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:54:17.708 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:54:17.711 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:54:47.786 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:54:47.789 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:55:17.856 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:55:17.859 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:55:47.984 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:55:47.988 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:56:18.054 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:56:18.057 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:56:48.117 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:56:48.120 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:57:18.253 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:57:18.257 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:57:48.335 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:57:48.338 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:58:18.418 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:58:18.421 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:58:48.529 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:58:48.532 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:59:18.601 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:59:18.604 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:59:48.679 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:59:48.682 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:59:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T15:59:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T16:00:18.757 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:00:18.760 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:00:48.827 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:00:48.829 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:01:18.889 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:01:18.892 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:01:48.983 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:01:48.986 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:02:19.062 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:02:19.065 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:02:49.132 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:02:49.136 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:03:19.244 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:03:19.247 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:03:49.322 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:03:49.325 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:04:19.408 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:04:19.412 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:04:49.570 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:04:49.573 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:05:19.799 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:05:19.802 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:05:49.859 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:05:49.862 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:06:20.023 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:06:20.026 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:06:50.166 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:06:50.169 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:07:20.261 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:07:20.264 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:07:50.334 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:07:50.337 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:08:20.468 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:08:20.471 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:08:50.529 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:08:50.532 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:09:20.606 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:09:20.609 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:09:50.980 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:09:50.983 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:09:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T16:10:00.000+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T16:10:21.241 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:10:21.244 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:10:51.308 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:10:51.310 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:11:21.423 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:11:21.426 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:11:51.584 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:11:51.587 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:12:21.655 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:12:21.658 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:12:51.745 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:12:51.748 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:13:21.904 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:13:21.907 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:13:52.199 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:13:52.202 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:14:22.294 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:14:22.298 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:14:52.373 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:14:52.377 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:15:22.485 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:15:22.488 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:15:52.566 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:15:52.569 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:16:22.650 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:16:22.653 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:16:52.804 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:16:52.807 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:17:22.891 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:17:22.894 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:17:52.960 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:17:52.963 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:18:23.098 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:18:23.101 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:18:53.167 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:18:53.170 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:19:23.237 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:19:23.241 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:19:53.358 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:19:53.361 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:19:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T16:19:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T16:20:23.445 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:20:23.448 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:20:53.515 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:20:53.519 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:21:23.651 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:21:23.654 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:21:54.014 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:21:54.018 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:22:24.109 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:22:24.113 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:22:54.186 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:22:54.191 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:23:24.332 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:23:24.337 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:23:54.420 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:23:54.425 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:24:24.501 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:24:24.507 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:24:54.643 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:24:54.646 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:25:24.712 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:25:24.715 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:25:54.783 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:25:54.787 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:26:24.936 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:26:24.943 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:26:55.008 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:26:55.012 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:27:25.080 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:27:25.084 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:27:55.238 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:27:55.243 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:28:25.400 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:28:25.403 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:28:55.487 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:28:55.490 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:29:25.573 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:29:25.577 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:29:55.684 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:29:55.687 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:29:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T16:29:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T16:30:25.754 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:30:25.757 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:30:55.833 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:30:55.836 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:31:26.032 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:31:26.035 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:31:56.107 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:31:56.111 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:32:26.180 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:32:26.183 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:32:56.298 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:32:56.301 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:33:26.644 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:33:26.647 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:33:56.713 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:33:56.717 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:34:26.817 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:34:26.820 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:34:56.892 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:34:56.895 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:35:26.960 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:35:26.963 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:35:57.052 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:35:57.055 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:36:27.146 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:36:27.149 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:36:57.225 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:36:57.228 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:37:27.296 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:37:27.299 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:37:57.449 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:37:57.452 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:38:27.510 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:38:27.513 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:38:57.589 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:38:57.592 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:39:27.725 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:39:27.728 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:39:57.796 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:39:57.800 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:39:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T16:40:00.000+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T16:40:27.867 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:40:27.870 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:40:57.994 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:40:57.997 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:41:28.306 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:41:28.310 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:41:58.393 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:41:58.396 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:42:28.520 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:42:28.523 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:42:58.617 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:42:58.620 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:43:28.696 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:43:28.700 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:43:58.761 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:43:58.764 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:44:28.836 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:44:28.839 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:44:58.906 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:44:58.909 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:45:29.002 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:45:29.005 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:45:59.114 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:45:59.116 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:46:29.202 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:46:29.206 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:46:59.307 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:46:59.310 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:47:29.433 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:47:29.436 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:47:59.518 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:47:59.523 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:48:29.589 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:48:29.593 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:48:59.742 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:48:59.746 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:49:30.029 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:49:30.032 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:49:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T16:49:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T16:50:00.112 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:50:00.115 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:50:30.262 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:50:30.265 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:51:00.399 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:51:00.402 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:51:30.473 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:51:30.476 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:52:00.574 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:52:00.577 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:52:30.725 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:52:30.728 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:53:00.801 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:53:00.805 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:53:30.873 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:53:30.877 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:54:01.027 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:54:01.030 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:54:31.106 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:54:31.109 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:55:01.175 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:55:01.178 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:55:31.246 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:55:31.249 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:56:01.299 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:56:01.302 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:56:31.370 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:56:31.374 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:57:01.530 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:57:01.533 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:57:31.601 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:57:31.604 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:58:01.671 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:58:01.674 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:58:31.816 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:58:31.819 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:59:01.896 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:59:01.899 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:59:31.960 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:59:31.963 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:00:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T16:59:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T17:00:02.110 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:00:02.114 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:00:32.239 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:00:32.242 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:01:02.316 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:01:02.320 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:01:32.477 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:01:32.480 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:02:02.623 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:02:02.627 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:02:32.682 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:02:32.686 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:03:02.845 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:03:02.849 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:03:32.950 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:03:32.954 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:04:03.037 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:04:03.040 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:04:33.173 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:04:33.176 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:05:03.243 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:05:03.246 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:05:33.329 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:05:33.332 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:06:03.401 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:06:03.404 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:06:33.529 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:06:33.532 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:07:03.607 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:07:03.611 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:07:33.677 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:07:33.681 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:08:03.745 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:08:03.749 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:08:33.826 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:08:33.828 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:09:03.897 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:09:03.900 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:09:34.032 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:09:34.035 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:10:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T17:09:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T17:10:04.119 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:10:04.123 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:10:34.205 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:10:34.208 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:11:04.335 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:11:04.338 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:11:34.406 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:11:34.409 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:12:04.478 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:12:04.481 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:12:34.587 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:12:34.590 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:13:04.775 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:13:04.778 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:13:34.843 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:13:34.846 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:14:05.021 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:14:05.024 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:14:35.078 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:14:35.081 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:15:05.149 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:15:05.152 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:15:35.233 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:15:35.236 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:16:05.337 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:16:05.340 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:16:35.415 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:16:35.418 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:17:05.511 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:17:05.515 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:17:35.621 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:17:35.624 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:18:05.691 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:18:05.694 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:18:35.759 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:18:35.762 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:19:05.831 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:19:05.834 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:19:35.895 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:19:35.898 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:19:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T17:19:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T17:20:05.963 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:20:05.966 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:20:36.042 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:20:36.045 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:21:06.145 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:21:06.148 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:21:36.233 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:21:36.236 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:22:06.352 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:22:06.356 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:22:36.434 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:22:36.437 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:23:06.576 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:23:06.579 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:23:36.654 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:23:36.657 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:24:06.732 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:24:06.735 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:24:36.821 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:24:36.824 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:25:06.950 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:25:06.953 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:25:37.024 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:25:37.027 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:26:07.095 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:26:07.099 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:26:37.228 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:26:37.231 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:27:07.330 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:27:07.333 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:27:37.401 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:27:37.404 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:28:07.471 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:28:07.474 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:28:37.774 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:28:37.777 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:29:07.835 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:29:07.838 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:29:37.931 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:29:37.934 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:30:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T17:29:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T17:30:08.002 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:30:08.006 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:30:38.079 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:30:38.082 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:31:08.154 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:31:08.157 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:31:38.245 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:31:38.249 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:32:08.338 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:32:08.341 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:32:38.410 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:32:38.413 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:33:08.547 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:33:08.550 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:33:38.619 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:33:38.622 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:34:08.692 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:34:08.695 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:34:38.849 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:34:38.852 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:35:08.927 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:35:08.930 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:35:39.000 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:35:39.003 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:36:09.152 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:36:09.156 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:36:39.479 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:36:39.482 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:37:09.574 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:37:09.578 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:37:39.669 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:37:39.673 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:38:09.806 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:38:09.809 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:38:39.868 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:38:39.871 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:39:10.063 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:39:10.066 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:39:40.126 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:39:40.129 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:39:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T17:39:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T17:40:10.190 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:40:10.193 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:40:40.256 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:40:40.259 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:41:10.377 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:41:10.380 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:41:40.439 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:41:40.442 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:42:10.525 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:42:10.529 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:42:40.661 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:42:40.664 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:43:10.729 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:43:10.732 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:43:40.801 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:43:40.804 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:44:10.922 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:44:10.925 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:44:40.977 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:44:40.981 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:45:11.046 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:45:11.050 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:45:41.174 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:45:41.179 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:46:11.244 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:46:11.247 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:46:41.314 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:46:41.317 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:47:11.459 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:47:11.462 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:47:41.658 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:47:41.661 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:48:11.732 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:48:11.735 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:48:41.886 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:48:41.889 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:49:12.025 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:49:12.028 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:49:42.077 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:49:42.080 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:49:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T17:49:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T17:50:12.196 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:50:12.200 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:50:42.333 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:50:42.335 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:51:12.409 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:51:12.412 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:51:42.474 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:51:42.477 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:52:12.559 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:52:12.562 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:52:42.630 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:52:42.633 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:53:12.725 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:53:12.729 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:53:42.854 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:53:42.856 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:54:13.067 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:54:13.071 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:54:43.144 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:54:43.148 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:55:13.248 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:55:13.251 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:55:43.393 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:55:43.397 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:56:13.471 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:56:13.475 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:56:43.541 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:56:43.544 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:57:13.677 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:57:13.680 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:57:43.740 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:57:43.743 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:58:13.818 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:58:13.821 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:58:43.888 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:58:43.892 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:59:13.975 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:59:13.978 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:59:44.038 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:59:44.042 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:00:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T17:59:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T18:00:14.098 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:00:14.101 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:00:44.168 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:00:44.172 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:01:14.238 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:01:14.241 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:01:44.309 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:01:44.312 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:02:14.386 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:02:14.388 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:02:44.449 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:02:44.452 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:03:14.594 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:03:14.597 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:03:44.659 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:03:44.662 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:04:14.725 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:04:14.728 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:04:44.795 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:04:44.798 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:05:14.865 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:05:14.869 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:05:44.963 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:05:44.967 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:06:15.098 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:06:15.102 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:06:45.285 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:06:45.287 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:07:15.363 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:07:15.366 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:07:45.491 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:07:45.494 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:08:15.595 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:08:15.598 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:08:45.681 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:08:45.684 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:09:15.751 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:09:15.754 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:09:45.879 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:09:45.883 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:10:00.001 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T18:09:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T18:10:16.250 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:10:16.254 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:10:46.312 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:10:46.316 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:11:16.483 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:11:16.486 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:11:46.627 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:11:46.630 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:12:16.709 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:12:16.712 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:12:46.783 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:12:46.786 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:13:16.928 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:13:16.931 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:13:46.999 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:13:47.001 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:14:17.068 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:14:17.071 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:14:47.222 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:14:47.225 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:15:17.493 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:15:17.496 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:15:47.553 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:15:47.556 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:16:17.692 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:16:17.695 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:16:47.837 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:16:47.839 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:17:17.909 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:17:17.912 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:17:47.986 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:17:47.989 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:18:18.131 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:18:18.134 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:18:48.192 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:18:48.196 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:19:18.337 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:19:18.340 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:19:48.448 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:19:48.451 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:20:00.001 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T18:19:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T18:20:18.510 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:20:18.513 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:20:48.647 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:20:48.651 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:21:18.776 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:21:18.779 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:21:48.895 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:21:48.899 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:22:19.051 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:22:19.054 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:22:49.135 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:22:49.138 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:23:19.297 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:23:19.300 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:23:49.357 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:23:49.361 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:24:19.503 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:24:19.506 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:24:49.657 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:24:49.660 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:25:19.801 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:25:19.805 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:25:49.912 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:25:49.918 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:26:20.049 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:26:20.052 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:26:50.143 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:26:50.146 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:27:20.306 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:27:20.309 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:27:50.450 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:27:50.454 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:28:20.570 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:28:20.573 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:28:50.723 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:28:50.727 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:29:20.802 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:29:20.805 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:29:50.921 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:29:50.925 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:30:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T18:29:59.998+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T18:30:21.050 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:30:21.053 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:30:51.186 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:30:51.189 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:31:21.272 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:31:21.275 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:31:51.401 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:31:51.404 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:32:21.522 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:32:21.526 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:32:51.633 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:32:51.636 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:33:21.779 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:33:21.782 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:33:51.923 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:33:51.926 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:34:22.026 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:34:22.030 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:34:52.163 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:34:52.166 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:35:22.300 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:35:22.304 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:35:52.378 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:35:52.381 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:36:22.506 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:36:22.509 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:36:52.651 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:36:52.654 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:37:22.727 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:37:22.730 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:37:52.875 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:37:52.878 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:38:22.936 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:38:22.939 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:38:53.064 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:38:53.067 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:39:23.158 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:39:23.161 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:39:53.321 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:39:53.324 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:39:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T18:40:00.000+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T18:40:23.390 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:40:23.392 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:40:53.510 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:40:53.513 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:41:23.583 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:41:23.586 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:41:53.650 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:41:53.653 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:42:23.747 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:42:23.750 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:42:53.917 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:42:53.920 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:43:24.053 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:43:24.056 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:43:54.173 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:43:54.176 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:44:24.300 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:44:24.304 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:44:54.359 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:44:54.363 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:45:24.507 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:45:24.510 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:45:54.693 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:45:54.696 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:46:24.797 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:46:24.800 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:46:54.951 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:46:54.954 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:47:25.019 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:47:25.023 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:47:55.106 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:47:55.109 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:48:25.260 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:48:25.263 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:48:55.396 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:48:55.399 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:49:25.541 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:49:25.544 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:49:55.652 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:49:55.655 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:50:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T18:49:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T18:50:25.789 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:50:25.792 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:50:55.883 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:50:55.886 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:51:26.036 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:51:26.039 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:51:56.182 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:51:56.185 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:52:26.335 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:52:26.338 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:52:56.446 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:52:56.449 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:53:26.600 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:53:26.603 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:53:56.653 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:53:56.656 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:54:26.765 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:54:26.768 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:54:56.843 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:54:56.846 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:55:26.971 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:55:26.974 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:55:57.066 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:55:57.068 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:56:27.202 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:56:27.204 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:56:57.331 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:56:57.333 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:57:27.666 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:57:27.670 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:57:57.726 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:57:57.729 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:58:27.797 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:58:27.800 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:58:57.875 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:58:57.878 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:59:27.937 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:59:27.940 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:59:57.999 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:59:58.001 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:00:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T18:59:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T19:00:28.069 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:00:28.072 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:00:58.129 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:00:58.132 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:01:28.208 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:01:28.211 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:01:58.286 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:01:58.289 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:02:28.434 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:02:28.436 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:02:58.575 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:02:58.578 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:03:28.713 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:03:28.717 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:03:58.839 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:03:58.843 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:04:28.968 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:04:28.971 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:04:59.213 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:04:59.215 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:05:29.273 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:05:29.276 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:05:59.418 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:05:59.421 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:06:29.530 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:06:29.533 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:06:59.649 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:06:59.652 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:07:29.752 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:07:29.755 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:07:59.872 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:07:59.875 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:08:29.975 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:08:29.978 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:09:00.095 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:09:00.098 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:09:30.231 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:09:30.235 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:10:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T19:09:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T19:10:00.359 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:10:00.362 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:10:30.524 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:10:30.528 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:11:00.665 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:11:00.668 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:11:30.785 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:11:30.787 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:12:00.930 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:12:00.933 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:12:31.024 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:12:31.051 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:13:01.153 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:13:01.155 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:13:31.272 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:13:31.276 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:14:01.400 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:14:01.404 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:14:31.474 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:14:31.477 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:15:01.624 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:15:01.626 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:15:31.726 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:15:31.729 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:16:01.871 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:16:01.873 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:16:31.982 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:16:31.986 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:17:02.128 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:17:02.131 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:17:32.255 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:17:32.257 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:18:02.333 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:18:02.336 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:18:32.395 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:18:32.398 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:19:02.456 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:19:02.459 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:19:32.517 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:19:32.520 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:20:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T19:19:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T19:20:02.587 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:20:02.590 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:20:32.668 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:20:32.671 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:21:02.740 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:21:02.743 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:21:32.804 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:21:32.807 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:22:02.867 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:22:02.869 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:22:32.943 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:22:32.946 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:23:03.030 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:23:03.033 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:23:33.106 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:23:33.109 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:24:03.236 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:24:03.240 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:24:33.314 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:24:33.317 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:25:03.384 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:25:03.387 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:25:33.529 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:25:33.531 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:26:03.591 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:26:03.594 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:26:33.735 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:26:33.738 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:27:03.829 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:27:03.832 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:27:33.966 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:27:33.969 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:28:04.044 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:28:04.047 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:28:34.189 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:28:34.193 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:29:04.253 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:29:04.256 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:29:34.369 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:29:34.373 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:30:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T19:29:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T19:30:04.526 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:30:04.528 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:30:34.585 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:30:34.587 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:31:04.658 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:31:04.661 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:31:34.741 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:31:34.744 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:32:04.817 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:32:04.820 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:32:34.896 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:32:34.899 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:33:05.017 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:33:05.020 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:33:35.103 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:33:35.106 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:34:05.179 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:34:05.182 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:34:35.284 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:34:35.287 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:35:05.419 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:35:05.422 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:35:35.498 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:35:35.501 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:36:05.626 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:36:05.629 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:36:35.763 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:36:35.766 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:37:05.866 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:37:05.869 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:37:36.027 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:37:36.030 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:38:06.103 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:38:06.106 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:38:36.183 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:38:36.187 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:39:06.255 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:39:06.258 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:39:36.313 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:39:36.317 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:40:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T19:39:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T19:40:06.391 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:40:06.394 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:40:36.455 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:40:36.458 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:41:06.608 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:41:06.611 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:41:36.769 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:41:36.772 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:42:06.913 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:42:06.916 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:42:36.983 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:42:36.986 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:43:07.060 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:43:07.063 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:43:37.147 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:43:37.150 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:44:07.226 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:44:07.229 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:44:37.288 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:44:37.291 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:45:07.386 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:45:07.389 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:45:37.451 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:45:37.455 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:46:07.504 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:46:07.507 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:46:37.567 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:46:37.570 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:47:07.653 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:47:07.656 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:47:37.713 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:47:37.716 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:48:07.782 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:48:07.785 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:48:37.845 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:48:37.848 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:49:07.997 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:49:08.000 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:49:38.116 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:49:38.119 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:50:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T19:49:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T19:50:08.185 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:50:08.188 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:50:38.241 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:50:38.243 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:51:08.468 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:51:08.471 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:51:38.580 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:51:38.583 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:52:08.716 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:52:08.718 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:52:38.827 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:52:38.830 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:53:08.938 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:53:08.941 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:53:39.067 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:53:39.070 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:54:09.202 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:54:09.205 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:54:39.266 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:54:39.270 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:55:09.338 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:55:09.341 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:55:39.479 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:55:39.482 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:56:09.607 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:56:09.610 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:56:39.718 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:56:39.722 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:57:09.863 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:57:09.866 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:57:40.008 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:57:40.011 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:58:10.162 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:58:10.165 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:58:40.281 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:58:40.284 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:59:10.362 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:59:10.365 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:59:40.480 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:59:40.482 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:00:00.001 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T19:59:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T20:00:10.616 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:00:10.619 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:00:40.746 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:00:40.749 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:01:10.915 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:01:10.918 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:01:41.060 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:01:41.063 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:02:11.155 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:02:11.157 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:02:41.300 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:02:41.303 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:03:11.453 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:03:11.456 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:03:41.590 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:03:41.593 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:04:11.754 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:04:11.757 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:04:41.827 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:04:41.830 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:05:11.899 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:05:11.902 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:05:41.961 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:05:41.963 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:06:12.039 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:06:12.042 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:06:42.108 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:06:42.112 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:07:12.187 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:07:12.190 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:07:42.250 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:07:42.253 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:08:12.322 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:08:12.325 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:08:42.386 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:08:42.389 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:09:12.465 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:09:12.468 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:09:42.543 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:09:42.546 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:10:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T20:09:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T20:10:12.610 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:10:12.613 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:10:42.691 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:10:42.694 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:11:12.762 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:11:12.765 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:11:42.834 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:11:42.837 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:12:12.897 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:12:12.899 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:12:42.961 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:12:42.964 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:13:13.032 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:13:13.036 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:13:43.112 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:13:43.115 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:14:13.193 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:14:13.195 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:14:43.256 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:14:43.259 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:15:13.328 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:15:13.331 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:15:43.391 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:15:43.394 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:16:13.472 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:16:13.475 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:16:43.540 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:16:43.542 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:17:13.618 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:17:13.621 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:17:43.686 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:17:43.689 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:18:13.750 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:18:13.754 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:18:43.814 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:18:43.817 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:19:13.902 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:19:13.904 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:19:43.986 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:19:43.989 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:20:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T20:19:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T20:20:14.061 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:20:14.065 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:20:44.150 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:20:44.153 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:21:14.255 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:21:14.258 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:21:44.313 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:21:44.316 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:22:14.398 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:22:14.401 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:22:44.462 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:22:44.465 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:23:14.534 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:23:14.537 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:23:44.610 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:23:44.613 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:24:14.669 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:24:14.671 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:24:44.750 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:24:44.753 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:25:14.821 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:25:14.824 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:25:44.880 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:25:44.884 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:26:14.956 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:26:14.959 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:26:45.029 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:26:45.032 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:27:15.090 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:27:15.093 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:27:45.154 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:27:45.157 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:28:15.226 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:28:15.229 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:28:45.288 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:28:45.291 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:29:15.369 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:29:15.372 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:29:45.439 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:29:45.441 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:30:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T20:29:59.998+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T20:30:15.568 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:30:15.571 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:30:45.663 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:30:45.665 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:31:15.742 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:31:15.746 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:31:45.811 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:31:45.814 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:32:15.914 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:32:15.917 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:32:46.059 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:32:46.062 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:33:16.194 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:33:16.198 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:33:46.340 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:33:46.343 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:34:16.476 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:34:16.481 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:34:46.639 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:34:46.642 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:35:16.792 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:35:16.795 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:35:46.929 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:35:46.933 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:36:16.993 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:36:16.997 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:36:47.145 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:36:47.148 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:37:17.231 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:37:17.234 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:37:47.351 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:37:47.354 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:38:17.504 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:38:17.507 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:38:47.560 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:38:47.563 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:39:17.628 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:39:17.631 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:39:47.697 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:39:47.700 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:40:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T20:39:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T20:40:17.768 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:40:17.771 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:40:47.864 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:40:47.867 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:41:17.944 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:41:17.947 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:41:48.003 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:41:48.006 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:42:18.079 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:42:18.082 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:42:48.151 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:42:48.155 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:43:18.223 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:43:18.226 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:43:48.286 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:43:48.289 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:44:18.350 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:44:18.353 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:44:48.414 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:44:48.417 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:45:18.477 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:45:18.480 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:45:48.540 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:45:48.543 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:46:18.611 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:46:18.614 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:46:48.676 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:46:48.680 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:47:18.747 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:47:18.751 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:47:48.833 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:47:48.836 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:48:18.907 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:48:18.911 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:48:48.973 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:48:48.976 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:49:19.042 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:49:19.044 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:49:49.114 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:49:49.117 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:50:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T20:49:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T20:50:19.202 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:50:19.205 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:50:49.285 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:50:49.288 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:51:19.372 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:51:19.375 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:51:49.442 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:51:49.446 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:52:19.587 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:52:19.590 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:52:49.681 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:52:49.684 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:53:19.817 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:53:19.820 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:53:49.903 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:53:49.906 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:54:19.967 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:54:19.969 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:54:50.027 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:54:50.030 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:55:20.164 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:55:20.167 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:55:50.242 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:55:50.246 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:56:20.332 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:56:20.336 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:56:50.398 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:56:50.401 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:57:20.460 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:57:20.463 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:57:50.522 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:57:50.525 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:58:20.594 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:58:20.597 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:58:50.744 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:58:50.747 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:59:20.822 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:59:20.824 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:59:50.901 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:59:50.904 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:00:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T20:59:59.998+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T21:00:20.974 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:00:20.977 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:00:51.066 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:00:51.069 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:01:21.151 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:01:21.156 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:01:51.207 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:01:51.211 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:02:21.278 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:02:21.281 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:02:51.338 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:02:51.342 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:03:21.483 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:03:21.487 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:03:51.612 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:03:51.614 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:04:21.740 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:04:21.743 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:04:51.826 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:04:51.829 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:05:21.938 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:05:21.941 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:05:52.049 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:05:52.053 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:06:22.220 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:06:22.223 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:06:52.315 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:06:52.318 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:07:22.443 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:07:22.446 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:07:52.571 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:07:52.574 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:08:22.716 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:08:22.719 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:08:52.810 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:08:52.813 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:09:22.946 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:09:22.949 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:09:53.017 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:09:53.020 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:10:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T21:09:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T21:10:23.078 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:10:23.081 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:10:53.141 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:10:53.144 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:11:23.302 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:11:23.306 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:11:53.414 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:11:53.417 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:12:23.559 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:12:23.562 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:12:53.720 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:12:53.724 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:13:23.831 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:13:23.833 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:13:53.968 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:13:53.971 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:14:24.028 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:14:24.031 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:14:54.158 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:14:54.161 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:15:24.311 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:15:24.315 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:15:54.456 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:15:54.460 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:16:24.577 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:16:24.580 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:16:54.638 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:16:54.642 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:17:24.716 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:17:24.720 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:17:54.780 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:17:54.784 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:18:24.851 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:18:24.854 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:18:54.908 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:18:54.911 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:19:24.978 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:19:24.981 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:19:55.042 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:19:55.045 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:20:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T21:19:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T21:20:25.102 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:20:25.139 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:20:55.202 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:20:55.205 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:21:25.354 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:21:25.358 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:21:55.420 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:21:55.423 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:22:25.492 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:22:25.495 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:22:55.601 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:22:55.605 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:23:25.746 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:23:25.750 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:23:55.808 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:23:55.811 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:24:25.879 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:24:25.882 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:24:55.964 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:24:55.967 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:25:26.033 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:25:26.036 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:25:56.095 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:25:56.098 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:26:26.176 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:26:26.180 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:26:56.242 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:26:56.246 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:27:26.328 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:27:26.331 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:27:56.407 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:27:56.410 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:28:26.497 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:28:26.500 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:28:56.562 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:28:56.565 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:29:26.639 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:29:26.642 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:29:56.703 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:29:56.706 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:30:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T21:29:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T21:30:26.799 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:30:26.803 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:30:56.884 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:30:56.887 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:31:26.951 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:31:26.955 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:31:57.024 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:31:57.028 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:32:27.094 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:32:27.098 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:32:57.157 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:32:57.160 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:33:27.254 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:33:27.257 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:33:57.325 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:33:57.328 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:34:27.390 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:34:27.394 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:34:57.519 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:34:57.522 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:35:27.656 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:35:27.659 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:35:57.767 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:35:57.770 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:36:27.911 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:36:27.916 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:36:58.006 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:36:58.010 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:37:28.067 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:37:28.070 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:37:58.120 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:37:58.123 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:38:28.195 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:38:28.198 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:38:58.268 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:38:58.271 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:39:28.339 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:39:28.342 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:39:58.403 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:39:58.406 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:39:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T21:39:59.998+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T21:40:28.489 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:40:28.492 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:40:58.558 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:40:58.561 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:41:28.628 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:41:28.632 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:41:58.706 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:41:58.710 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:42:28.781 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:42:28.784 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:42:58.845 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:42:58.848 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:43:28.924 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:43:28.926 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:43:58.994 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:43:58.997 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:44:29.066 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:44:29.069 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:44:59.130 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:44:59.134 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:45:29.194 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:45:29.197 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:45:59.366 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:45:59.369 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:46:29.453 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:46:29.456 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:46:59.530 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:46:59.533 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:47:29.598 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:47:29.601 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:47:59.670 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:47:59.673 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:48:29.731 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:48:29.733 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:48:59.851 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:48:59.854 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:49:29.955 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:49:29.958 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:49:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T21:50:00.000+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T21:50:00.117 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:50:00.120 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:50:30.177 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:50:30.181 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:51:00.314 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:51:00.318 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:51:30.493 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:51:30.496 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:52:00.630 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:52:00.635 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:52:30.732 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:52:30.735 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:53:00.852 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:53:00.856 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:53:31.061 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:53:31.064 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:54:01.208 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:54:01.211 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:54:31.279 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:54:31.283 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:55:01.431 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:55:01.434 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:55:31.518 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:55:31.522 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:56:01.639 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:56:01.643 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:56:31.799 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:56:31.802 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:57:01.877 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:57:01.881 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:57:32.005 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:57:32.008 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:58:02.112 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:58:02.115 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:58:32.220 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:58:32.223 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:59:02.366 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:59:02.370 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:59:32.513 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:59:32.516 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:59:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T21:59:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T22:00:02.580 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:00:02.583 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:00:32.658 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:00:32.661 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:01:02.737 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:01:02.740 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:01:32.810 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:01:32.815 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:02:02.894 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:02:02.897 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:02:32.970 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:02:32.973 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:03:03.034 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:03:03.037 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:03:33.111 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:03:33.114 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:04:03.255 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:04:03.258 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:04:33.334 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:04:33.337 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:05:03.413 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:05:03.416 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:05:33.476 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:05:33.479 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:06:03.539 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:06:03.542 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:06:33.612 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:06:33.615 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:07:03.699 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:07:03.702 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:07:33.780 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:07:33.783 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:08:03.864 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:08:03.868 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:08:33.957 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:08:33.961 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:09:04.020 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:09:04.023 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:09:34.092 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:09:34.095 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:09:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T22:09:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T22:10:04.161 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:10:04.165 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:10:34.228 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:10:34.232 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:11:04.376 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:11:04.379 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:11:34.504 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:11:34.508 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:12:04.593 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:12:04.596 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:12:34.735 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:12:34.738 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:13:04.805 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:13:04.809 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:13:34.934 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:13:34.937 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:14:05.029 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:14:05.032 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:14:35.140 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:14:35.144 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:15:05.268 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:15:05.271 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:15:35.347 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:15:35.350 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:16:05.409 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:16:05.412 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:16:35.497 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:16:35.500 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:17:05.572 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:17:05.575 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:17:35.648 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:17:35.652 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:18:05.712 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:18:05.717 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:18:35.776 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:18:35.779 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:19:05.855 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:19:05.859 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:19:35.927 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:19:35.931 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:20:00.002 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T22:19:59.998+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T22:20:05.992 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:20:05.995 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:20:36.071 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:20:36.074 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:21:06.159 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:21:06.162 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:21:36.289 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:21:36.292 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:22:06.363 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:22:06.366 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:22:36.441 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:22:36.444 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:23:06.504 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:23:06.508 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:23:36.656 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:23:36.659 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:24:06.792 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:24:06.795 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:24:36.854 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:24:36.857 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:25:06.991 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:25:06.995 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:25:37.103 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:25:37.106 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:26:07.240 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:26:07.243 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:26:37.351 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:26:37.355 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:27:07.480 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:27:07.483 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:27:37.617 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:27:37.620 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:28:07.753 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:28:07.756 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:28:37.835 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:28:37.839 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:29:07.900 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:29:07.903 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:29:38.012 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:29:38.016 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:30:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T22:29:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T22:30:08.091 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:30:08.094 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:30:38.214 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:30:38.217 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:31:08.338 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:31:08.342 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:31:38.425 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:31:38.428 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:32:08.569 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:32:08.572 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:32:38.689 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:32:38.692 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:33:08.763 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:33:08.766 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:33:38.834 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:33:38.837 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:34:08.922 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:34:08.926 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:34:38.985 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:34:38.988 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:35:09.046 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:35:09.050 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:35:39.130 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:35:39.132 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:36:09.195 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:36:09.198 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:36:39.273 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:36:39.276 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:37:09.344 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:37:09.347 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:37:39.417 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:37:39.420 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:38:09.480 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:38:09.483 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:38:39.552 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:38:39.555 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:39:09.649 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:39:09.652 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:39:39.720 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:39:39.723 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:40:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T22:39:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T22:40:09.786 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:40:09.789 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:40:39.889 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:40:39.892 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:41:09.977 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:41:09.980 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:41:40.048 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:41:40.051 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:42:10.141 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:42:10.144 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:42:40.217 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:42:40.220 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:43:10.347 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:43:10.350 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:43:40.493 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:43:40.496 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:44:10.578 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:44:10.582 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:44:40.724 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:44:40.727 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:45:10.886 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:45:10.889 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:45:40.964 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:45:40.967 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:46:11.041 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:46:11.044 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:46:41.107 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:46:41.110 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:47:11.180 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:47:11.183 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:47:41.251 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:47:41.254 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:48:11.313 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:48:11.316 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:48:41.411 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:48:41.414 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:49:11.468 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:49:11.471 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:49:41.547 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:49:41.550 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:50:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T22:49:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T22:50:11.609 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:50:11.612 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:50:41.681 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:50:41.684 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:51:11.745 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:51:11.748 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:51:41.841 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:51:41.844 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:52:11.904 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:52:11.907 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:52:41.976 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:52:41.979 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:53:12.036 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:53:12.038 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:53:42.111 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:53:42.114 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:54:12.175 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:54:12.177 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:54:42.247 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:54:42.250 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:55:12.307 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:55:12.310 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:55:42.368 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:55:42.371 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:56:12.429 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:56:12.432 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:56:42.500 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:56:42.502 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:57:12.564 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:57:12.567 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:57:42.647 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:57:42.650 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:58:12.708 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:58:12.710 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:58:42.853 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:58:42.856 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:59:12.990 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:59:12.993 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:59:43.111 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:59:43.114 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:00:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T22:59:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T23:00:13.171 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:00:13.174 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:00:43.317 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:00:43.320 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:01:13.436 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:01:13.439 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:01:43.565 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:01:43.568 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:02:13.676 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:02:13.679 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:02:43.804 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:02:43.807 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:03:13.957 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:03:13.960 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:03:44.119 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:03:44.122 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:04:14.256 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:04:14.259 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:04:44.391 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:04:44.395 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:05:14.620 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:05:14.624 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:05:44.683 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:05:44.688 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:06:14.744 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:06:14.747 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:06:44.818 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:06:44.821 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:07:14.890 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:07:14.892 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:07:44.978 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:07:44.981 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:08:15.051 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:08:15.054 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:08:45.106 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:08:45.109 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:09:15.170 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:09:15.173 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:09:45.240 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:09:45.244 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:10:00.001 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T23:09:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T23:10:15.361 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:10:15.364 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:10:45.452 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:10:45.455 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:11:15.517 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:11:15.520 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:11:45.578 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:11:45.581 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:12:15.633 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:12:15.636 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:12:45.721 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:12:45.725 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:13:15.798 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:13:15.801 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:13:45.873 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:13:45.876 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:14:15.938 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:14:15.941 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:14:46.000 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:14:46.003 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:15:16.063 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:15:16.066 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:15:46.197 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:15:46.200 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:16:16.266 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:16:16.269 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:16:46.403 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:16:46.405 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:17:16.732 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:17:16.735 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:17:46.809 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:17:46.812 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:18:16.878 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:18:16.881 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:18:47.040 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:18:47.043 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:19:17.176 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:19:17.180 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:19:47.321 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:19:47.325 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:20:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T23:19:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T23:20:17.458 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:20:17.462 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:20:47.594 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:20:47.597 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:21:17.739 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:21:17.742 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:21:47.834 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:21:47.837 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:22:17.903 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:22:17.906 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:22:48.009 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:22:48.011 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:23:18.076 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:23:18.079 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:23:48.151 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:23:48.154 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:24:18.299 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:24:18.303 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:24:48.378 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:24:48.382 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:25:18.441 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:25:18.444 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:25:48.600 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:25:48.603 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:26:18.728 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:26:18.732 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:26:48.890 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:26:48.892 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:27:18.950 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:27:18.954 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:27:49.027 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:27:49.032 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:28:19.100 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:28:19.103 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:28:49.176 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:28:49.181 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:29:19.238 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:29:19.241 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:29:49.314 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:29:49.317 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:29:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T23:29:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T23:30:19.377 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:30:19.380 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:30:49.449 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:30:49.452 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:31:19.511 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:31:19.514 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:31:49.596 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:31:49.599 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:32:19.672 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:32:19.676 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:32:49.743 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:32:49.747 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:33:19.804 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:33:19.809 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:33:49.887 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:33:49.891 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:34:19.943 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:34:19.946 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:34:50.047 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:34:50.050 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:35:20.110 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:35:20.113 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:35:50.182 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:35:50.185 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:36:20.247 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:36:20.250 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:36:50.384 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:36:50.387 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:37:20.496 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:37:20.499 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:37:50.648 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:37:50.652 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:38:20.785 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:38:20.788 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:38:50.871 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:38:50.875 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:39:21.024 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:39:21.027 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:39:51.126 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:39:51.129 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:39:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T23:39:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T23:40:21.238 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:40:21.241 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:40:51.366 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:40:51.369 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:41:21.487 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:41:21.490 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:41:51.690 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:41:51.693 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:42:21.767 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:42:21.770 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:42:51.921 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:42:51.924 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:43:22.023 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:43:22.026 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:43:52.168 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:43:52.172 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:44:22.300 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:44:22.304 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:44:52.433 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:44:52.435 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:45:22.577 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:45:22.581 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:45:52.672 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:45:52.675 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:46:22.810 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:46:22.813 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:46:52.937 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:46:52.940 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:47:23.090 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:47:23.093 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:47:53.184 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:47:53.187 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:48:23.330 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:48:23.333 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:48:53.433 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:48:53.436 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:49:23.569 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:49:23.571 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:49:53.642 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:49:53.646 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:49:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T23:49:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T23:50:23.717 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:50:23.720 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:50:53.794 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:50:53.797 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:51:23.873 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:51:23.876 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:51:53.937 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:51:53.940 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:52:24.003 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:52:24.006 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:52:54.090 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:52:54.092 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:53:24.168 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:53:24.171 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:53:54.241 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:53:54.244 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:54:24.324 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:54:24.327 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:54:54.392 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:54:54.395 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:55:24.457 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:55:24.460 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:55:54.520 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:55:54.523 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:56:24.583 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:56:24.587 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:56:54.679 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:56:54.682 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:57:24.759 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:57:24.762 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:57:54.831 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:57:54.834 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:58:24.904 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:58:24.907 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:58:54.983 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:58:54.985 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:59:25.048 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:59:25.051 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:59:55.143 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:59:55.145 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:59:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-06T23:59:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T00:00:25.297 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:00:25.300 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:00:55.437 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:00:55.441 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:01:25.588 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:01:25.591 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:01:55.732 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:01:55.735 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:02:25.795 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:02:25.798 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:02:55.855 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:02:55.858 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:03:25.930 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:03:25.934 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:03:56.005 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:03:56.008 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:04:26.156 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:04:26.159 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:04:56.229 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:04:56.232 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:05:26.286 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:05:26.289 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:05:56.390 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:05:56.394 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:06:26.454 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:06:26.456 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:06:56.525 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:06:56.529 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:07:26.588 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:07:26.591 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:07:56.669 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:07:56.673 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:08:26.748 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:08:26.751 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:08:56.813 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:08:56.816 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:09:26.870 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:09:26.873 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:09:56.940 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:09:56.943 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:09:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-07T00:09:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T00:10:27.004 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:10:27.008 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:10:57.075 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:10:57.078 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:11:27.142 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:11:27.145 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:11:57.218 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:11:57.221 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:12:27.298 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:12:27.302 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:12:57.387 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:12:57.390 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:13:27.462 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:13:27.465 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:13:57.529 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:13:57.532 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:14:27.619 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:14:27.622 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:14:57.739 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:14:57.742 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:15:27.858 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:15:27.861 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:15:58.004 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:15:58.007 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:16:28.148 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:16:28.151 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:16:58.227 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:16:58.230 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:17:28.354 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:17:28.358 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:17:58.485 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:17:58.489 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:18:28.559 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:18:28.562 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:18:58.631 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:18:58.634 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:19:28.784 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:19:28.788 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:19:58.852 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:19:58.856 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:19:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-07T00:19:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T00:20:28.989 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:20:28.993 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:20:59.109 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:20:59.112 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:21:29.237 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:21:29.240 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:21:59.350 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:21:59.353 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:22:29.427 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:22:29.431 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:22:59.488 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:22:59.491 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:23:29.569 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:23:29.572 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:23:59.641 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:23:59.644 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:24:29.714 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:24:29.717 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:24:59.801 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:24:59.804 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:25:29.931 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:25:29.934 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:26:00.066 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:26:00.069 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:26:30.127 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:26:30.130 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:27:00.273 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:27:00.276 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:27:30.417 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:27:30.420 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:28:00.562 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:28:00.565 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:28:30.674 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:28:30.677 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:29:00.835 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:29:00.838 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:29:30.988 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:29:30.991 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:30:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-07T00:30:00.000+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T00:30:01.150 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:30:01.154 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:30:31.287 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:30:31.290 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:31:01.355 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:31:01.358 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:31:31.484 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:31:31.487 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:32:01.553 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:32:01.557 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:32:31.698 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:32:31.701 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:33:01.780 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:33:01.784 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:33:31.852 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:33:31.855 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:34:01.923 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:34:01.926 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:34:31.987 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:34:31.990 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:35:02.139 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:35:02.142 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:35:32.206 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:35:32.209 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:36:02.311 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:36:02.314 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:36:32.374 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:36:32.378 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:37:02.438 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:37:02.441 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:37:32.502 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:37:32.505 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:38:02.631 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:38:02.634 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:38:32.702 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:38:32.705 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:39:02.996 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:39:02.999 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:39:33.065 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:39:33.068 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:39:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-07T00:39:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T00:40:03.135 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:40:03.138 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:40:33.263 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:40:33.266 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:41:03.409 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:41:03.412 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:41:33.570 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:41:33.574 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:42:03.722 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:42:03.726 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:42:33.884 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:42:33.887 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:43:03.971 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:43:03.974 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:43:34.141 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:43:34.145 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:44:04.302 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:44:04.305 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:44:34.380 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:44:34.383 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:45:04.527 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:45:04.531 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:45:34.614 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:45:34.617 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:46:04.725 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:46:04.728 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:46:34.786 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:46:34.790 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:47:04.932 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:47:04.935 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:47:35.018 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:47:35.021 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:48:05.130 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:48:05.134 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:48:35.225 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:48:35.229 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:49:05.302 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:49:05.305 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:49:35.373 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:49:35.376 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:50:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-07T00:49:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T00:50:05.446 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:50:05.449 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:50:35.514 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:50:35.517 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:51:05.583 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:51:05.585 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:51:35.663 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:51:35.667 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:52:05.740 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:52:05.743 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:52:35.868 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:52:35.871 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:53:05.930 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:53:05.933 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:53:35.992 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:53:35.995 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:54:06.079 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:54:06.083 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:54:36.159 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:54:36.162 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:55:06.222 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:55:06.225 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:55:36.281 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:55:36.284 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:56:06.349 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:56:06.352 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:56:36.421 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:56:36.425 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:57:06.495 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:57:06.498 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:57:36.560 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:57:36.563 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:58:06.648 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:58:06.657 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:58:36.716 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:58:36.719 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:59:06.792 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:59:06.796 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:59:36.864 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:59:36.867 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:00:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-07T00:59:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T01:00:06.933 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:00:06.937 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:00:36.998 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:00:37.001 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:01:07.063 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:01:07.067 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:01:37.127 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:01:37.130 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:02:07.194 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:02:07.198 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:02:37.259 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:02:37.262 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:03:07.330 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:03:07.333 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:03:37.393 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:03:37.396 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:04:07.468 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:04:07.472 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:04:37.552 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:04:37.555 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:05:07.617 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:05:07.620 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:05:37.780 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:05:37.783 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:06:07.865 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:06:07.868 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:06:38.019 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:06:38.025 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:07:08.197 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:07:08.200 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:07:38.317 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:07:38.321 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:08:08.395 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:08:08.398 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:08:38.507 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:08:38.510 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:09:08.602 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:09:08.605 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:09:38.764 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:09:38.773 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:10:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-07T01:09:59.998+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T01:10:08.867 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:10:08.870 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:10:38.988 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:10:38.991 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:11:09.075 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:11:09.078 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:11:39.221 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:11:39.223 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:12:09.286 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:12:09.289 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:12:39.351 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:12:39.354 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:13:09.462 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:13:09.465 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:13:39.592 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:13:39.595 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:14:09.736 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:14:09.740 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:14:39.882 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:14:39.885 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:15:10.028 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:15:10.031 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:15:40.114 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:15:40.117 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:16:10.242 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:16:10.249 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:16:40.307 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:16:40.310 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:17:10.493 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:17:10.496 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:17:40.601 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:17:40.604 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:18:10.730 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:18:10.734 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:18:40.892 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:18:40.895 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:19:11.031 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:19:11.034 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:19:41.182 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:19:41.186 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:20:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-07T01:19:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T01:20:11.335 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:20:11.338 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:20:41.421 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:20:41.425 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:21:11.486 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:21:11.490 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:21:41.550 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:21:41.553 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:22:11.621 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:22:11.624 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:22:41.701 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:22:41.704 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:23:11.764 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:23:11.767 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:23:41.824 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:23:41.828 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:24:11.899 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:24:11.901 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:24:41.963 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:24:41.966 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:25:12.117 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:25:12.120 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:25:42.238 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:25:42.242 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:26:12.384 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:26:12.386 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:26:42.470 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:26:42.473 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:27:12.623 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:27:12.626 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:27:42.701 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:27:42.704 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:28:12.830 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:28:12.833 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:28:42.933 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:28:42.936 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:29:13.009 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:29:13.012 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:29:43.132 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:29:43.135 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:30:00.000 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-07T01:29:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T01:30:13.210 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:30:13.214 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:30:43.313 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:30:43.316 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:31:13.441 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:31:13.444 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:31:43.526 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:31:43.528 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:32:13.681 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:32:13.684 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:32:43.753 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:32:43.756 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:33:13.823 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:33:13.826 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:33:43.940 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:33:43.943 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:34:14.094 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:34:14.097 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:34:44.164 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:34:44.167 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:35:14.343 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:35:14.347 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:35:44.407 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:35:44.410 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:36:14.576 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:36:14.579 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:36:44.753 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:36:44.756 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:37:14.814 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:37:14.817 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:37:44.877 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:37:44.880 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:38:14.972 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:38:14.975 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:38:45.047 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:38:45.050 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:39:15.117 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:39:15.120 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:39:45.181 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:39:45.185 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:39:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-07T01:39:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T01:40:15.326 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:40:15.331 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:40:45.385 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:40:45.388 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:41:15.475 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:41:15.488 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:41:45.555 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:41:45.558 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:42:15.650 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:42:15.653 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:42:45.709 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:42:45.712 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:43:15.776 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:43:15.780 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:43:45.906 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:43:45.909 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:44:16.068 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:44:16.071 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:44:46.397 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:44:46.401 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:45:16.551 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:45:16.554 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:45:46.662 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:45:46.669 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:46:16.830 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:46:16.833 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:46:46.977 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:46:46.980 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:47:17.097 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:47:17.101 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:47:47.217 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:47:47.221 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:48:17.370 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:48:17.374 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:48:47.448 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:48:47.451 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:49:17.519 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:49:17.522 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:49:47.654 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:49:47.659 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:49:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-07T01:49:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T01:50:17.819 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:50:17.823 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:50:47.954 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:50:47.957 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:51:18.070 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:51:18.072 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:51:48.201 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:51:48.205 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:52:18.313 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:52:18.320 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:52:48.476 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:52:48.479 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:53:18.596 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:53:18.602 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:53:48.757 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:53:48.761 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:54:18.895 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:54:18.907 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:54:49.054 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:54:49.058 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:55:19.284 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:55:19.287 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:55:49.345 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:55:49.348 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:56:19.457 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:56:19.461 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:56:49.627 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:56:49.630 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:57:19.763 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:57:19.766 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:57:49.874 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:57:49.878 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:58:20.011 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:58:20.014 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:58:50.075 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:58:50.078 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:59:20.185 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:59:20.217 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:59:50.388 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:59:50.391 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:59:59.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-03-07T01:59:59.999+0000 7fdff4f5e700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T02:00:20.459 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:00:20.462 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:00:50.629 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:00:50.631 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:01:20.692 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:01:20.697 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:01:50.760 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:01:50.763 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:02:20.836 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:02:20.839 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:02:50.992 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:02:50.995 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:03:21.120 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:03:21.123 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:03:51.214 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:03:51.218 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:04:21.353 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:04:21.357 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:04:51.496 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:04:51.500 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:05:21.634 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:05:21.637 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:05:51.720 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:05:51.728 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T02:06:02.683 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-03-07T02:06:02.685 DEBUG:teuthology.task.console_log:Killing console logger for smithi003 2023-03-07T02:06:02.686 DEBUG:teuthology.task.console_log:Killing console logger for smithi136 2023-03-07T02:06:02.686 DEBUG:teuthology.exit:Finished running handlers